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FOREWORD 



The American Association of Colleges for Teacher Education (AACTE) 1s 
pleaded to publish this paper because of Its relevance to teacher education 
and to the education profession generally. This monograph addresses one of 
the critical questions involved 1n designing and implementing pre- and in- 
service teacher education programs, namely: What does research say about 
teacher competence and teacher effectiveness? The answer to that question 
will be particularly useful for those teacher educators who are reexamining 
the objectives of their present preparation programs, those evaluating the 
effectiveness of their .programs, and those experimenting with performance/ 
competency-based teacher education programs. 

But what research says about teacher competence and teacher, effective- 
ness 1s of Interest to and has critical, implications for other educators as 
well: classroom teachers, teacher organizations, teacher center directors, 
school administrators, state departments of education, professional standards 
^commissions, the U. S. Office of Education, educational researchers, school 
board members, and the general public. Because of the nature of the topic 
and the way 1n which it is addressed, we believe that this monograph 1s a 
significant addition to educational literature. 

The author, Dr. Donald M. Medley, has brought to the task of analyzing 
and synthesizing the results of research studies on teacher competence and 
teacher effectiveness a rich background of experience in research methodology. 
He is well known and respected in the field of educational research. His 
contribution 1n this work includes not only the substantive findings, but a 
unique metnodology for carrying out this task. 

Dr. Medley was commissioned by AACTE ! s Committee on Performance- Based 
Teacher Education to develop this monograph. While the study was aenerated 
under -the auspices of the PBTE project, the Committee from the beginning was 
well aware that the results would have implications far beyond the design and 
Implementation of performance/ competency-based teacher education programs. 

The study, which 1s endorsed by the Committee, was conducted under. its 
general supervision. To augment its own expertise in the area of educational 
research, the Committee created a researchers' panel to work with Or. Medley 
during the course of the study. Members of this panel are identified on the 
inside cover of this monograph. 

The contributions of the researchers' panel, as acknowledged by the 
author, were especially helpful in developing the final product. Most of their 
comments (see Appendix C) were highly complimentary. Some of the reviewers' 
suggestions were incorporated into the study. Some of their objections would 
evaporate 1f the reviewers' accepted our purpose— to present interim findings 
that can be used to improve teacher education new while we wait for the 
researchers to produce definitive results. A number of other objections are 
disarmed by the results obtained. Meaningful, dependable, and consistent 
findings were uncovered, anc more of them than these objections, if valid, 
would lead us to expect. The author must have done something right. 

AACTE acknowledges with appreciation the role of the National Center 
for Improvement of Educational Systems (NCIES) of the U. S. Office of Education 
in the PBTE Project. Its financial support (provided through the Interstate 
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Certification Project of the New YorF State Department of Education) as well as 
its professional stimulation, particularly that of Allen Schmieder, are major 
contributions to the Committee's work. The Association also acknowledges the 
significant c?nt-»" u'i.-, of the author and his support staff, and that of the 
members of the Committee a^d researchers' panel . Special recognition is due 
Lorrin Kennamer, PPTF committee chairn:an, Shirley tionneville of the project 
staff, and Annette MacKinnon, technical editor, for their contributions" to 
the development of this publication. 



F.Di.'ARD C. PCM 



•1ERCY 



KARL MASSANARI 



Executive Director, AACTE 



Associate Director, AACTE 



and Director, PBTE Project 
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Former Professor and Chairman 
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University of Georgia 
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Dr. Shearron was associated closely with AACTE's 
PBTE Project since its inception. He served as a 
committee member, and provided valuable assistance 
in conceptualizing the design of leadership 
training institutes and in their implementation. 
He was one of the architects of the University of 
Georgia Elementary Education Model fn the late 60's. 
Since that time he provided leadership in experiment- 
ing with a competency-based preparation program for 
elementary teachers. He provided wise counsel to 
AACTE's Committee and to institutions of higher 
education regarding the potential and pitfalls of 
implementing competency-based teacher education 
programs. 

Dr. Shearron' s professional life was dedicated to 
the improvement of education for children through 
experimenting with more effective ways to prepare 
school personnel. The education profession will 
miss his creative leadership, and those who knew 
him as Gil will miss the inspiration of working 
with him personally. 
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INTRODUCTION 



It 1s the primary purpose of this report to provide the teacher educator 
with access to the meaningful findings of research 1n teacher effectiveness. 

In the last few years, the advent of a major Innovation 1n teacher 
education— performance-based teacher education— has. made the Importance of 
these findings—and of access to them-- »more apparent Ithan ever before. 

The central notion behind performance-based teacher education 1s that 
declsl&ns about a teacher's career— about passage through preservice training, 
certification, promotion, recert1f1cat1on, and so on— should be based on 
demonstrated competency to perform in ways that an effective teacher performs. 
Implementation of this idea requires that the nature of effective teacher 
performance be specified *n sufficient, detail. Then it 1s possible to measure 
to what degree, and 1n what ways, the performance of any individual teacher 
resembles effective performance. 



Knowledge of Teacher Effectiveness 

' Efforts to develop performance-based programs both for educating and 
certifying teachers have made It painful iyf*clear 'jtfsi how Inadequate the base 
is 'for what we know today about ,the dynamics of te&&er effectiveness. These 
efforts have also demonstrated how weak the connection is between research in 
teacher effectiveness and the teacher education curriculum. 

There seem to be two major reasons why this is so. One has to do with 
the quality and quantity of research findings to date; the other has to do 
with access to these findings. 

First, research in teacher effectiveness 1s much more difficult and 
expensive to do well than research in most other aspects of the education^ 
process. Technical difficulties are formidable and, until recently, were°not 
even suspected by most researchers 1n the area. For ,th1s reason, many of the 
findings reported were Inaccurate and, therefore, inconsistent with each other. 
Recent research has been better designed and better supported; it has also 
greatly Increased both the sheer amount of results reported in the Uteratyre 
and the difficulty of access by anyone uhable or unwilling to work full time ■ 
on the problem. % 

Second, whenever teacher educators attempt to sift these findings they 
find the task so difficult and time, consuming that they . can scarcely be blamed 
if they abandon 1t. The Hterature*of the Subject 1s vast and inaccessible, 
and much of it 1s difficult to comprehend -and evaluate. 

A number of sound scholarly reviews of this literature have appeared in 
recent years (cf. Rosenshlne, 1971, 1976; Rosenshine and Furst, 1971, 1973; 
Dunkln and Biddle, 1974; Brophy . and Evertson, 1976?). These are invaluable; 
but the reader comes away with the feeling (not really justified) that there 
has been access, not to the research Itself, but to a synthesis or Interpretati 



*See References following the text. ' 



of that research. This leaves the reader at the mercy of what Dunkln and 
Biddle (op. dt.) refer to as the "commitment" of the reviewer. 

In this project we have made a strong effort to put the reader 1n direct 
contact with the research. We have canvassed the literature and culled the 
most significant findings from 1t, without attempting to select or Interpret 
them or to reconcile them with each other. We have then presented them In a 
series of tables 1n a particularly simple format. 



Interpretation of Findings 

Readers of this report are invited to examine the process-product corre- 
lations presented 1n Tables 3-43 and draw their own conclusions. These tables 
were designed to communicate the most clearly established facts about effective 
teaching and only those facts. They constitute what we regard as the principal 
product of our Investigation. 

In reading the pages to follow, 1t is important to bear in mind certain 
limitations; the procedures we followed made an effort to reduce the complex- 
ities 1n many thousands of correlations to something both accurate and com- 
prehensible. 

First, we have presented only the strongest and most dependable findings, 
ignoring both small correlations that are statistically significant, and 
larger correlations that are not. The fact that a relationship 1s not reported 
should not be taken as evidence that 1t does not exist, or even as indicating 
that there is no research evidence that it exists. Absence of a relationship 
from Tables 3-43 means only that its existence has not b,een clearly established 
as far as we can discover. If a relationship is reported in the tables, there 
is strong evidence that it does exist. The reader whose questions are not 
answered 1n these tables is urged to consult the original, studies or the 
comprehensive reviews cited previously for more details. 

The second limitation we v/ould like to emphasize has to do with general - 
izability. For reasons mainly connected with the funding strategy of the 
U. S. Offtce of Education, most of the research summarized here was done in 
one segment of the school population— in classes of Grade III or below 1n 
which most of the pupils come from homes of lov; socioeconomic status. To 
what extent these findings apply to pupils with other backgrounds or 1n 
other grades 1s not known. What evidence we have about pupils of high socio- 
economic status and pupils 1n the higher grades indicates that results from . 
one group do not Always apply to another. 



Dangers of Misinterpretation 

A secondary product of this Investigation 1s our own reading of "some of 
the conclusions these facts support. If these conclusions seem' Incorrect, 
the reader can go to the facts and draw others. The only rule that ohe should 
follow is what we tried to observe: a valid Interpretation, must fit 'all the 
facts. Anyone who selects some facts and rejects others on any basis whatsoever 
w1Vl reach conclusions which cannot be said to be based on the facts, thereby 
defeating the v/hole purpose of the enterprise. 




14 



In education especially, no more serious obstacle to the advancement of 
knowledge exists than the universal tendency we have To embrace and remember 
research findings that fit our expectations, and to reject and forget those 
that do not* Educators who do not frequently question and alter their beliefs 
to suit research findings should suspect themselves of impeding rather than 
aiding progress in the field. 

Particularly vulnerable to misinterpretation are the suggestive findings 
reported herein abQUt possible differences in optimal strategy for teaching 
primary grade pupils from low and high socioeconomic backgrounds* Most of us 
have strong convictions about these matters* -One group, the group opposed to 
classroom integration, will be inclined to overinterpret these findings, losing 
sight of their tentative t nature (they come from a single study done in a small 
number of classrooms in a single city) because the results agree with their 
biases. Another group, those who favor integration, will be inclined to 
undervalue the results, concluding that they are incorrect because they do 
not agree with their biases. 

Neither group will advance tov/ard the solution of the problem so long 
as they follow this practice of evaluating data on the basis of the conclusions 
reached rather than on the basis of their quality. As far as they go, these 
data do indicate that optimum learning in the two SES groups requires quite 
different teaching strategies* What educators must do is to interpret these 
results in combination with all other evidence available, and if the evidence 
is not strong enough either to substantiate or to discredit the conclusion, to 
keepr an open mind and press for more research. 

Another of the unavoidable risks that attends the publication of research' 
findings is that readers with preconceived attitudes and various axes to grind 
will misinterpret these findings to suit their own ends. To prevent distortion 
of research findings, to frustrate those who quote out of context or even 
misquote the findings, a researcher would be forced to withhold publication of 
the facts entirely. In this case, the cure would be worse than the disease. - 
At present, while we do not have enough facts, it is still important to 
disseminate what facts there are and so reduce our ignorance. 



Waiting for Definitive Results Before Doing Anything 

This is a strategy that appeals to some because it sounds very, logical ♦ 
The -argument seems to be that if you don't do anything, you can't do any 
harm* Since we do not yet have a full and complete understanding of the 
dynamics of effective teaching, we are expected to ignore the imperfect 
knowledge that we do possess and do nothing that requires such knowledge* 

How fortunate it is for the human race that at least some of our ancestors 
did not subscribe to this position. If Columbus had waited until he had a 
complete and accurate map of the world before setting sail, his little fleet 
would still be sitting in Genoa. 

Very few decisions worth making can be put off until there is adequate 
information to base them on* In medicine— and poker, most actions must be 
taken, most decisions made, on insufficient data* Patients die, and money 
is lost, because action is taken when data are inadequate— but more patients 
and more money would be lost if no action were taken at all. 
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So too, educators must make decisions everyday, regardless of the 
availability of hard evidence on which to Base them. With this need 1n mind, 
we have proceeded. 



We believe that after reading this report and studying the findings 
presented, the reader will agree that no serious student of teaching can 
afford to be ignorant of the findings produced by research 1n teacher effec- 
tiveness. 
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PROCEDURE 



The basic bibliography of this study consisted of 289 studies* which 
purported to shed light on the question, "How does the behavior of effective 
teachers differ from that of Ineffective teachers?" These studies were the 
survivors of a weed1ng-out process from an original 11st of 732 Items. Most 
of the 445 rejected Items were rejected because they reported no original 
research; some were reviews of research; others theoretical, philosophical, 
or opinionated discussions (from the armchair) of what a good teacher ought 
to do. 

The remaining 289 Items were examined for empirically obtained relation- 
ships between how a teacher behaves and how much the pupils learn from him or 
her, commonly called proaeee product relationships, c our criteria were used 
1n deciding whether or not a reported relationship should be Included in this 
review. Only those which met all four criteria were Included. Briefly, the 

criteria were: • 

j \ 

1. *' The study from whlfch a relationship came had to be 

designed so that the relationship was general izable 
to some population of teachers sjarger than the sample , 
studied. • 

2. The relationship had to be both reliable enough to be 
statistically significant and large enough to be prac- 
tically significant., 

3. The measure of teacher effectiveness had to be based on 
long-term pupil gains 1n achievement areas recognized 
as Important goals of education. 

r 

4. The process measure had to specify the behaviors 
exhibited in such a way that they could be reproduced 
as desired. 

.By the time we had applied these criteria to the thousands ,of reported 
relationships between teacher behaviors and pupil learning reported in the 
literature, -the number of relationships which survived was 613; and these 613 
correlations all came from just 14 of the 28^ studies. Since our standards 
turned out to be so severe In their effect, 1t seems appropriate to discuss 
them further. 



Rationale of the Study 

"All four criteria proceed logically from a point of view adopted in this 
study which is at variance with that underlying most of the research reviewed. 
This viewpoint jnay be described briefly as follows: 

The ultimate base of teacher education curriculum must be a thorough 
understanding of the dynamics of effective teaching— o* '/hat e tcac! or nust 



*See Appendix B, Bibliography, 
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know, and be, and do, 1n order to provide the greatest possible assistance to 
pupils 1n their efforts to achieve the goals of education. Such understanding 
depends on the establishment of cause-and-effect relationships between teacher 
behavior and pupil learning. Only when we know why a teacher 1s effective— as 
well as how— can we decide how best to train teachers. 

The recognized purpose of research 1n teacher effectiveness is to develop 
such an understanding by discovering the cause-and-effect relationships from 
which this understanding may be derived. -Teacher education cannot become a 
fully rational and knowledge-based enterprise until such an understanding has 
been developed to a degree far beyond what exists at present. 

What 1s the proper course of action for the teacher educator to follow 
while waitinj for the researcher to develop this knowledge bit by bit? Should 
there be a moratorium on teacher education until the research catches up? 

Obviously not; the schools of this country need teachers, and this need 
must be met by programs designed to give the prospective teacher all the help 
possible. These programs are based on the judgment and intuition or cumulative 
wisdom of lifelong students of teaching. There 1s little doubt that they do a 
lot to improve 'teaching. There is less doubt that. they could do a lot more if 
the research base were adequate. 

Are there interim findings of the research that can help teacher educators 
do a better job— or must we wait until the researcher is satisfied that the 
findings are definitive before touching them?. This project was undertaken 
under the assumption that interim results can be useful. The nature of the 
research is such that it generates information that 1s currently useful to 
teacher educators as 1s, no matter where the researchers are 1n their contin- 
uing search for cause-and-effect relationships between teacher behavior and 
pupil gain. Because the researchers collect their data by observing real 
teachers in real classrooms and measuring- what real pupils learn, what they 
observe can be useful today. 

-/ 

Suppose, then, that we forget about the cause-and-effect inferences the 
researchers worry about and examine their findings for information about 
competent teacher performance.' Suppose we examine them to see what they tell 
us about how the day-to-day practice of competent teachers differs from the 
day-to-day practice of less competent teachers. Does it not seem reasonable 
to expect that a novice teacher can benefit from learning the best current 
practices of competent teachers? What techniques and strategies are more 
likely to work for the novice on -the job than those techniques 'and strategies 
that work best for other teachers? This is the point of view we have used 1n 
this, survey pf the literature—that process-product research can tell us quite 
a lot about how competent and less competent teachers differ in their classroom 
behattior, even though we may not know exactly why. > 

A strong relationship between a behavior variable and a measure of 
teacher effectiveness need not be regarded as .evidence- that the observed 
behavior caused the measured effect. Ihstead.Vwe shall use the measure of 
effectiveness as an indicator of teacher, competence, inferring that teachers 
who are effective are nore competent on the average than teachers who are 
ineffective. The distinction between competent and effective implied 1n 
this statement is important and yet easy to forget. Competence has to do 
with how a teacher teaches and is measured 1n terms of the teacher's behavior; 
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how effective a teacher 1s 1s measured in terms of pupil learning. In other 
words, an effective teacher 1s always competent, but a competent teacher may 
not always' be .effective, for a multitude of reasons. t 

He shall view the behavior of the teacher as an effect rather than a 
cause, assuming that the competent. teacher behaves 1n a certain way because he 
or she ie competent. A strong relationship between teacher effectiveness and 
a particular behavior will be Interpreted as Indicating that such a behavior 
characterizes competent teachers, and therefore may deserve to be called a 
competency. 

••*»t Let us now examine, one by one, the criteria used 1n selecting relation- 
ships to be reported here. 



Criterion I. A Relationship That Is Generallzable 

The most Important criterion we have used 1n deciding whether a relation- 
ship should be reported or not has to do with the design of the study from which 
It comes. In 'brief, the study should be designed so that the results may 
legitimately be generalized to teachers other than those 1n the sample studied. 

Many of the studies that we examined were "methods experiments" 1n which 3 
one or more teachers taught the same material to two or more groups of pupils 
by two or more different methods, and the effects on pupils were examined to 
see whether the methods used affected the outcome. Such experiments are almost 
Invariably analyzed 1n such a way that the findings generalize to other pupils, f 
taught by the same teachers, but not to other teachers. If the results of 
such experiments are to be generalized to other teachers, it must 'be assumed 
that there 1s no Interaction between methods and teachers— that the method 
effect 1s the same for aTt teachers. This assumption 1s almost always false; 
unless 1t 1s shown to be true, the findings of the experiment tell us nothing 
about teacher effectiveness. 

Most of the "process-product" studies— studies 1n which samples of 
teachers were observed and their behaviors were correlated wlth^measures of 
mean gains 1n their classrooms— met this criterion automatical lyi, One methods 
experiment, Project CRAFT (see Appendix A), Was found which was designed- to 
yield results generallzable to other teachers; 1t 1s the only one which met 
all criteria for inclusion in this report. 



Criterion II. A Strong and Reliable Relationship 

Before the development of a given competency (behavior) 1s adopted as a 
program objective,' there should be strong evidence that the effectiveness of 
a. teacher who acquires that competency will Increase. Direct evidence of this 
1s obtainable only by adopting the competency as a program objective on an 
experimental basis and evaluating the consequences-. Meanwhile, .the magnitude 
of the relationship between the competency and pupil learnlng^asiestlmated 1n 
a process-product study provides the best evidence available about -tffrich 
competencies should be so tested. The stronger the relationship, jthe stronger 
the evidence the competency will be useful to the teacher. How strong should 
such a relationship be? 
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We have somewhat arbitrarily chosen a relationship equivalent to a linear 
correlation of ,39 as the minimum that will be reported. A correlation of this 
magnitude Indicates an overlap of 1 5% In the variances of the two measures 
Involved. It Is of the same order of magnitude as, for example, the correlation 
usually found between aptitude scores and college grades. Despite recent 
criticism of abuses of such scores, admissions offices have found them useful. 
A correlation of .39 between any test and a criterion Is regarded as acceptable 
evidence of validity In general practice. We have therefore reported no corre- 
lations below .39 In Tables 3-43. 

In addition, we have reported no relationship, whatever Its magnitude, 
unless It Is statistically significant at the 5% level. This means, of course, 
that the risk that a relationship due to chance (one which would not be expected 
to recur In a different sawple of teachers from the same population) would be 
reported In our tables 1s not greater than 5%. 

When the same behavior (or similar ones) correlates In the same way with 
the same kind of effectiveness measure In two or more studies, the risk that 
both are chance results becomes much smaller; such a relationship becomes as 
near a sure thing as we are ever likely to get. The Identification of such 
instances Is an Important goal of this Investigation. 

In the studles which* Involved larger samples of teachers, there were 
correlations that were statistically significant, but smaller than .39; In 
the. studies which used smaller samples of teachers, there were correlations 
greater than .39 which were not statistically significant. None of these 
was -.reported, ' 

-So stringent a criterion may seem likely to result In our overlooking 
many relationships that really exist. The danger maybe smaller than it. 
appears at first. Among the thousands of correlations run in all of these 
studies, most relationships of any^size have had several chances to show up. 
Lowering our criterion would admit many more unreliable and contradictory 
findings, and very few Important ones that would otherwise have been missed. 

When two inconsistent relationships are reported in this study— that is, 
when a pair of relationships that should agree (because J>oth Involve similar 
behaviors and similar outcome*) do not agree, the contradiction Is almost 
certain to be a real one. Since such pairs will usually come from different 
studies done In different teacher populations, they may contain Important 
Information about the effects of context on these relationships. On the 
other hand, since the different studies often Use different instruments, 
they may only reflect differences between definitions of similar behaviors 
on different Instruments. (It seems improbable that" such, semantic difference* 
could account for contradictory findings of this strength, however.) 



Criterion III. A Defensible Measure of Teacher Effectiveness 

The product measure In a relationship— the measure of pupil learning 
gains—Is regarded in this investigation as a means for identifying the 
competent teacher whose classroom practices are what we are trying to discover. 
To be defensible for this purpose, the measure should relate to pupil progress 
toward outcomes that society generally regards as Important— the kinds of 
outcomes, you might say, that teachers are hired to accomplish. 
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There hive been a number of studies of teacher effectiveness In which 
both teacher behaviors and pupil learnings have been measured during the 
teaching of a special unit (usually developed by the researcher) over a brief 
time— a week, a day, even an -hour. This 1s an excellent strategy for studying 
cause-and-effect relationships between teacher behavior and pupils 1 Immediate 
learning; but since such a product measure has no demonstrated relationship 
to teacher effectiveness 1n achieving long-term goals of education, such studies 
are Irrelevant to our purpose. The ability to raise pupils' scores on a unit 
test 1n a short period of time cannot be accepted as a measure of competent 
teaching, without evidence that the two are highly correlated. 

Virtually all of the reportable results we found employed measures of 
gains in reading or in arithmetic as the basis for assessing teacher effective- 
ness. ^Some of these studies also used measures of attitudes toward school 
or of changes in pupils 1 perceptions of the self to assess teacher" effectiveness 
1n these respects. Relationships with such gains were reported in addition to 
relationships with cognitive gains from the same study. One or two studies 
also reported relationships with gains 1n creativity, work-study skills, or 
other variables. These results were judged too scattered to be worth reporting 
here; 



Criterion IV. An Interpretable Measure of /Teacher Behavior 

To be useful for our purpose, a process measure must be defined so that 
the behavior involved is specified clearly enough to be reproducible when 
needed. To know that effective teachers explain clearly 1s of no use to the 
teacher educator unless one can tell just what a teacher does whfcn explaining 
clearly. Without this knowledge, how can one train a novice to tiehave 1n this 
way? In effect, this criterion has limited us mainly to what are called "low- 
Inference" observation Instruments, although, some use has been made of teacher 
s|lf-report data and even of what some authorities would classify as "high- 
inference" measures when the behavior 1n question was clearly described. 
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RESULTS AND CONCLUSIONS 



As we have pointed out, the primary objective of this report was to 
provide direct access to the findings of research on teacher effectiveness to 
teacher educators who lack the time, Inclination, or technical competence 1t 
would take to dig them out personally. Tables 3-43 were designed to accomplish 
this ; Anyone who reads the next few pages of this report can learn from them 
how to read these tables at a glance. Thus, whatever relevant, Important and 
reliable findings the research contains are at one's disposal. 

' Immediately following these notes on Interpreting the tables 1s a 
section 1n which we have tried to summarize some of the most consistent 
findings and provide our own Interpretation of them. In doing so, we have 
made no conscious use of any source of Information other than the data reported 
i. in the tables themselves. This has been done so that the reader who wishes to 
\use these findings in conjunction with information from other sources may be 
^sure that the information from the two sources 1s, 1n fact, Independent. Too 
often, conclusions reported 1n different places are in reality based on the 
same evidence and present a spurious consistency 1n appearance, thus gaining 
credibility 1n -much the same way as an oft-repeated rumor does". If the con- 
clusions we draw are consistent with our readers' own experience, then they 
may be regarded as mutually supportive. If they are Incpnsi stent, readers 
should go to the facts to verify our Interpretation— or *their own. 

Notes on Interpreting the Tables 

Table 1 illustrates the format 1n which the 613 relationships are dis- 
played 1n Tables ->3-43. (These tables are grouped together following the 
text:} 

The table title at the head of the page 1s meant to Identify a common 
element 1n the process measures listed at the left. under the heading "Behavior 
Item." These are identified where possible by the actual Item or category 
name used 1n the study; or when the name was not descriptive, a brief descrip- 
tive phrase is employed. 

At the right of the list of behaviors 1s a column indicating the grade 
level or levels of the classes in which the behaviors were observed. At the 
extreme right, under the heading "Source Symbol," are cqdes Identifying the 
studies from which the relationships reported for each behavior item came; 
when available, the number assigned to tfvMtem 1n the actual Instrument 1s 
also -included. This will enable the reader to refer to the original study 
and Identify specific Items. . 

The studies are listed, by code 1n Appendix A, with details about sample, 
instrumentation, and the like. 

Each letter m the body — L, M, or H— identifies a strong relationship; ^> 
and the location of the letter Identifies the two variables relatedi__tb tbe_ 
left 1s the behavior or process variable; above is the teacher effectiveness 
or product measure. 

Thus the first L .on the upper left tells us that a strong negative 
relationship was found between "Pup1l-1n1t1ated vs. teacher-initiated 
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Table 1 - PUPIL INITIATIONS 







LOW 


SES PUPILS 


HIGH 


SES 


PUPILS 




BEHAVIOR ITEM 


GRADE 


READING 
CAINS 

j rijiii If i { f V 

low high 


ARITHMETIC 

GAINS 
complexity 
low high 


AFFECTIVE 
CAINS 

school self 


READING 

GAINS 

co"*Dlexf ty 
low high 


ARITHMETIC 

GAINS 
complexity 
Iom high 


AFFECTIVE 
GAINS 

school self 


SOURPF 

SYMBOL ( 


PupH -Initiated vs. teacher-1n1t1ated 
Interchanges 


I 




L 1 






L 1 




WGC OScAR * 


Pupil -Initiated Interaction vs. 
response to teacher 


I-II 


L 1 


L 1 










S73 RCS1 


Pupil Initiates substantive 
interchange 


II 




L 1 






L 1 




WGC OScAR 


Pupil s.speak freely 


II 


L 1 






L 1 






WGC OScAR 


Pnn11 'fact—ppl a+pH rnrrrnon+c 

• Up 1 1 W»3N 1 ClfltCU wUIIIMClltD 

-to adults 


" III 




L 










SK 388a 


Pupil questions, requests, 
conmands--non-academ1 c 

, All non-respons1ve pupil 
utterances to adults 


III 
III 




L. L 
1 1 

U U 










SK 477c, 
346a 

SK 343a 


Pupil Initiates substantive Interchange 


nr-vm™ 




Hi 






H' H? 


— 1 


WGC OScAR 


Pupil volunteers Information vs. 
pupil asks for Information 


III-VIII 


H 1 




t 


Hi 






WGC OScAR 


■*> ^ 
Total pupil -Initiated contacts 


IV 










H H 




GG 


Pupil -Initiated vs. teacher-1n1t1ated 
substantive Interchange 


IX-XII 


Hi 






Hi 






WGC OScAR 



Interchanges" and gains on an arithmetic test made up of Items of high 
complexity, 1n "classes which contained pupils of low socioeconomic status. 
Me also note that they were first grade classes, that the relationship was 
reported In the Carroll County-West Georgia State study (WGC), and that the 
process Instrument used was OScAR. 

The superscript Un this Instance, a one) 1s used to Indicate that the 
relationship 1s shown twice 1n the same row of the table; 1n this case, 1t 
also appears under high complexity arithmetic gains 1n classes with pupils 
of high socioeconomic status.' Reference to Appendix A will verify that in 
the Carroll County (WGC) study, classes observed had pupils of mixed low 
and high socioeconomic status. « 

In the second line, we note a negative relationship between "Pupil- 
initiated Interaction vs. response to teacher" and gains on low-complexity 
reading test Items, and between the same Item and gains on low-complexity 
arithmetic test items, for pupils of low socioeconomic status in grades I 
and II, reported in Soar 1973 and based on the Reciprocal Category System, 
Factor 1. The superscript on the two £'s Indicates that the measure used 
contained Items on both. reading and arithmetic. 

In reading +he tables, the reader may interpret L as meaning that the 
frequency of the Dehavlor. in question 1s loo 1n the classes of effective 
teachers; or, 1n the case of bipolar measures (11 he' the first two Items 1n 
Table J which contrast two extremes), that the effective teacher will be at 
the lower Of the two poles*. Thus, effective teachers 1n the lower grades, 
according to these two studies, tend to Initiate more, and permit their pupils 
to Initiate fewer, interactions than the ineffective teachers. do. 

The line across the table divides results found 1n grades III or lower 
from those found in the higher grades. Because some studies combined results 
In grade III with those 1n higher grades, there 1s some overlap. 

Note that the Items below the line, which are* similar to those above 
the line, tend to show strong positive relationships— J/'s. In the upper grades, 
the frequency of pupil Initiations seems to be high in classes of effective 
teachers— a reversal from the lower grades. 

This particular table does not show any curvilinear relationships— does 
not contain anytf's. An M should be interpreted as meaning that the frequency 
of the behavior. 1n question 1s Intermediate 1n the effective teacher's (^ass, 
and may be either low or high 1n the ineffective teacher's class. 

Readers are now free to turn to the tables and make their own Interpre- 
tation. For those who are Interested, we now present some interpretations of 
our own. Please bear in mind that Interpretations should not he confused with 
the facts upon which they are based. 



The Structure of Teacher Competence 

■ .WheW 'independent relationships between a single behavior and two distinct 
kinds of teacher effectiveness are reported 1n a study, we have what will be 
•called; a pair of relationships. Such pairs contain Information about the 
structure of competent teaching which we now propose to examine. If the two 
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relationships 1n a pair match—If, for Instance, both are L*s (as was the case 
1n Table 1 with "Pupil questions, requests, conriands— non-academic*)-- the 
Implication 1s that teachers competent 1n the two different ways * >nd to behave 
alike. If thty do not match— 1f, for exairple, one 1s reported l end the other 
ff— the Indication 1s that teachers competent In one way behave 1n an opposite 
manner from teachers competent 1n the other way* By, examining, all such pairs 
of relationships 1n Tables 3-^53, we can get some Idea about the structure of 
competent teache** behavior* In other words, we can learn something about which 
behaviors are generic, 1n the sense that, they are equally effective for different 
objectives and with different kinds of pupils* 

We first examined all pairs 1n which one outcome was cognitive— a measure 
of achievement gain— and the other affective— a measure of pupils 1 attitudes 
toward school* Do teachers who work for and achieve maximum gains on achieve- 
ment tests do so at the expense of pupils- 1 attitudes toward school? ; Or are 
pupils 1 attitudes highest where achievement gains are also greatest? 

Table 2 shows that 1n the data presented 1n Tables 3-43 there were 54 . 
pairs of relationships 1n which one outcome was pupil achievement gains (of 
one kind or another) and the other outcome was pupils 1 attitudes toward school. 
The two relationships matched 1n 72% of the pairs. These figures suggest that 
a competent teacher of subject matter 1s likely to be developing positive 
attitudes toward school as well* 

Next we looked at 36 pairs of relationships 1n which one .outcome was a 
measure of pupil gains 1n achievement and the other a measure of Improvement 
fn pupil attitudes toward the self. Here we found that 75% -of these "p.airs. 
matched. This suggests that teachers who produce maximum achievement gains 
are also likely to Improve pupils' self-concept the most. These results do ' 
not support the notion that efforts to teach children to read and do arlth- - 
metlc— 1n and of themselves— are damaging to their self-esteem. 

When 80 pairs of relationships to effectiveness In the* two major content 
areas— arithmetic and reading— were examined, we found that 73% of them v 
matched. The Implication we^draw from this 1s that (1n these data at least) - 
there 1s relatively little difference in the behaviors of teachers effective * 
1n either of these two skill areas. (It may also be Important to note that * 
most of these data apply to Grade III or below^ 

When 158 pairs of relationships Involving low and high complexity out- 
comes were examined, 91% of them matched. This suggests that our effort to 
distinguish between Items of high and low complexity was not successful. * : 

* • 

Finally, we studied pairs of relationships in which the same outcome 
and behavior were correlated 1n both high and low SES classes. The"- figure of 
38% shown in Table 2 1s based entirely on data from one study (BE), since. this 
was the only study which analyzed relationships 1n both high and low SES 
classes separately. The conclusion we draw 1s that patterns of behavior of 
teachers effective with low SES pupils differ considerably from those of 
teach6rs effective with high SES pupils 1n thesS data, and should therefore 
be examined. separately. 

In* summary, the evidence 1s that, with early grade pupils of the sane 
SES level, the teacher who produces maximum achievement gains in either reading 
or arithmetic 1s quite likely to produce high gairis irv both subjects and at 
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Table 2 

Percents of Pairs ,of Process-Product Relationships Between 
the Same Behavior and Two Types of Outcome Measures That . 
' Match (I.e., HH, LL, or MM) 









• Relationships 
Paired 


Number of 
Pairs 


Percent 
Matching 


Attitude Toward School vs. 

Achievement Gains (same 
' &S level) 


- 

54 ■■ 


72 


Gains 1n Self -Concept vs. 

Achievement Gains (same 
, SES level) 


36 


75 


Reading Gains vs. Arithmetic Gains 
(same level of complexity and 
same SES level) 


80 


73 


High Complexity vs. Low Complexity 
Gains (same SES level) 


158 


91 


Gains 1n High SES Classes vs. 
Gains 1n Low SES Classes 
(same subject and level of 
complexity) 


84 


38 



both levels of complexity (as. defined in this paper), and 1n the pupils' seK- 
conceot and attitudes toward school as well. There 1s also evidence (from one 
study) that competent teachers of low SES pupil s behave quite differently from 
competent teachers of high SES pupils. 



The Competent Teacher of Low SES Pupils 1n the Primary Grades 

In this section, we will examine the differences between the behavior of 
teachers of low SES pupils whose classes show high mean gains on achievement 
tests of arithmetic, reading, or both, and the behaviors of teachers of low 
SES pupils whose classes show low mean gains on these tests. Wo shall concen- 
trate on those relationships which are reported more than once, preferably in 
two .or more different studies. Since there is evidence that some of these 
behaviors may be negatively related to pupil attitudes toward themselves and 
toward school, We shall also discuss relationships to attitudes when available. 

Teacher Use of Time . The effective teacher of low SES pupils 1n Grade III 
or below differs from the ineffective ceacher in devoting more class time to 
task-related or "academic" activities (6, S73).* A large portion of pupils 1 
time 1s described 1n one study as structured, while another (SK) reports more 
interactions related to lesson content, more class time, more academic activity, 
and less time in which a child is unoccupied. 

Two studies (CRAFT, SK) reported more reading-related activities (7) in 
classes of more effective teachers; but a third study (BTES) seems to contradict 
these two. There is also a suggestion that the relationship may depend on the 
1 reading methods used (cf. Table 30). 

The amount of arithmetic activity (9) observed in one study (SK) v/as found 
to be higher in classes taught by effective teachers; the frequency of teaching 
operational skills was reported greater for the effective teachers in a second 
study (BTES). 

The number .of teacher questions asked and/or pupil- ansv/ers made (16) was 
found in one study (SK) to be higher in effective teachers' classes on several 
different items; however, a second study (BE) reported that the proportion of 
opportunities a pupil had to respond per unit of time in arithmetic lessons 
was lower in effective teachers' classrooms. This suggests that, even though 
the total amount of task-related activity is higher in the more effective 
teachers' classrooms, the distribution of such. activities between teacher 
questions and other task-related activities may also be Important. 

A filial confirmation, verified in two studies (SK, WGC), is provided by 
the fact that more effective teachers spend less class time discussing matters 
unrelated to lesson content (42). 

To summarize: mainly one study (SK) provides support for the conclusion 
that effective teachers of low SES pupils 1r. the primary grades engage .their 
pupil- in more lesson-related activities than less effective teachers do; yet 



*From here on 1ri the text, numbers in parentheses refer to tables, and code 
symbols refer to studies (identified in Appendix A). 
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there is enough confirmation f»*om other studies to justify considerable confi- 
dence that this conclusion is correct. It should also be noted that no evidence 
one way or the other was found that this particular kind of behavior was related 
to pupil attitudes toward school. 

Organizing for Instruction . Effective and ineffective teachers of low SES 
pupils also differ 1n how £hey usually organize their classrooms: it is the less 
effective teachers who spend more time working with pupils in small groups and 
less time working with the whole class or a large group of pupils (3). 

The evidence that effective teachers spend more time with large groups and 
less with small ones comes mainly from one study (SK) but is verified 1,n one 
other study (BTES). 

The.amount of time pupils spend working independently 1n small groups (4) 
is reported 1n two studies (S73, SK) as consistently lower in classes where 
achievement gains are high. The picture is very much the same with respect to 
seatwork (5), with closely similar findings reported in four different studies 
(BTESj WGC, S73, SK). 

, A fifth study .{BE) reports that effective teachers assign more seatwork 
than Ineffective ones', -but does not Indicate directly that the effective 
teachers* pupils spend more time in seatwork (which would conflict with the 
findings of other studies). The sixth item in Table 5 Indicates that effective 
teachers individualize assignments more than Ineffective ones do. These two 
Items suggest that effective and Ineffective teachers differ not only in the 
amount of seatwork they assign but also in what the pupils do at their seats. 
Evidence that the two types of teachers also behave differently during seatwork 
time will be presented below. 

There 1s some evidence 1n these tables (4, 5) that the amount of time 
pupils spend 1n small groups without a teacher (or other adult) present is 
related to their attitudes toward school. When the 1nd1v1dual..or group 1s 
described as working independently (SK 138, 142), attitudes toward school are 
high. Otherwise (S73 FLA6, TP4) they are low. It appears that teachers who 
permit more independent work have classes who Hke school better, but learn 
less; teachers who have a lot of noni independent small group work have classes 
who neither Hke school nor learn much. The teacher who permits the least 
amount of individual and small group work has the greatest gains in achieve- 
ment and gets mixed results as far as attitudes are concerned. Independent 
seatwork does not seem to help the pupils' self-image much either (SK 138, 142). 

Quality of Instruction. What kinds of questions and what ways of 
responding to pupils distinguish the more. effective teacher of low SES pupils 
from the less effective teacher? We have consistent evidence (Table 18) from 
four different studies (S72, S73, WGC, SK> that effective teachers of low SES 
pupils ask more questions classifiable in the lower levels of the Bloom 
taxonomy than Ineffective teachers do. This difference holds no matter how 
teacher effectiveness is defined— whether in terms of high or low complexity 
outcomes 1n arithmetic or in reading. A fifth study (BE) suggests that 
effectlye teachers of low SES students ask fewer "choice" questions— that is, 
questions which offer a limited choice of answers. The general conclusion 
that effective teachers prefer low-level questions seems justified, despite 
this one somewhat inconsistent finding* 
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Evidence that effective teachers also ask fewer high-level questions (19) 
Is less extensive, but the results from three studies (S72, S73, WGC) agree. 

Patterns of teacher reactions to pupil responses are complex; however, 
there are bindings from three studies (Perham, S73, BE) which Indicate that 
the effective teacher of low SES puplTs 1s less likely to be seen amplifying, 
discussing, or using pupil answers than the Ineffective teacher (21). The 
alternative to discussing a pupil answer 1s either to acknowledge 1t or to give 
feedback and then go on to something else. There is some evidence (SK, BE), ' 
. not entirely consistent (cf. BE S164), that this 1s what the effective teacher 
, \ Is likely to do (20). This seems consistent with a preference for low-level 
questions, since 1t 1s high-level questions-?- those calling for analysis, 
synthesis, evaluation— which, "are usually appropriate to discuss or amplify, 
not low- level 'ones. 

0 

The number cf pupil-Initiated questions and comments (14) also tends to 
be lower In classes taught by effective teachers than in those taught by 1nef- 
, fective ones, according to results reported 1n three studies (WGC, S73, SK). 
A Moreover, effective teachers treat pupil initiations differently than inef- 
fective teachers do (15); they are less likely to. listen and provide feedback 
- to pupils or to solicit questions from them than Ineffective teachers are 
(WGC, BE). 

It seems clear that 1n low SES classes' at this 'level, the competent 
teacher keeps Interaction at a low level of complexity- and pupil' Initiative. 
He or she does not encourage pupils to analyze, synthesize, evaluate, or Indeed 
to do anything but answer rather narrow questions asked by the teacher. The" 
teacher who encourages such pupils to express themselves freely, to think, to 
question, to discuss, 1s not effective 1n teaching, them to read or do arithmetic. 

The only evidence that any of this has ajJirect Impact on pupils' attitudes 
toward school 1s one Item (WGC TP23) suggesting that .pupil attitudes are low in . 
classrooms in which questions tend to be narrow and followed by quick feedback— 
that is, in classes taught by effective teachers (18). 
<o : 

Environmental Maintenance. Evidence from five studies (Bemis, S73, BTES, 
WGC, BE) Indicates that there is less deviant or disruptive pupil behavior- (35) 
in classes taught by effective teachers than in classes taught by ineffective 
teachers. One study (Bemis) reports more hyperactive pupil behavior in effective 
teachers' classes and more instances in which the teacher talks over pupil noise. 
Since the same study reports less disruptive pupil .behavior where there is more 
hyperactive pupil behavior, it would appear that neither of the two items 
reflects disruptive behavior but rather excitement that is probably task 
related. 

Data related to teacher rebukes (34) is consistent with these findings: 
such behavior is less frequent in the classrooms of more effective teachers 
(WGC, CRAFT). Findings fromthree studies (WGC, CRAFT, BE) also indicate that 
effective teachers devote less time to managing their classrooms than ineffective 
ones do (31). (This dovetails with the finding already reported that effective , 
teachers spend more time in academic activities.) 

There is also some evidence related to what may be called the quality of 
teachers' efforts at classroom management (32). Effective teachers differ from 
less effective ones in that they control their classrooms with less criticism 
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(cf. Table 34)', and use a more varied repertory of techniques 1n doing so (WGC). 
An effective teacher f s errors 1n management are more likely to take the form of 
overreactlons, and less likely that of errors 1n timing (32, BE); and a pattern 
1n which "the teacher supports- appropriate pupil behavior and Ignores Inappro- 
priate behavior was observed less often 1n the behavior of effective teachers 
(WGC). 

Effective teachers were found 1n three studies (SK, CR£FT, BE) to use 
more praise or positive motivation (40), although there were some indicators 
(CRAFT) that this depended on the context* Effective teachers were observed 
in one study (SK) to make more use of token reinforcement (39); but another 
study found 'that 1t was the ineffective ones v/ho reported most frequent use 
of such things as gold stars and special privileges (BE)* 

Permissive behav1or--g1v1ng pupils freedom to govern their own activities 
(43)— was consistently found to be more common 1n classes of less effective 
teachers (S73, WGC, BE)/ 

There 1s evidence from one study (WGC) that pupil attitudes are more 
favorable toward school 1n the more orderly environment maintained by the 
effective teacher (31, 32, 33, 34, 35). - 

In summary, the effective teacher maintains an environment that is 
supportive and, 1f not always quiet, free from disruptive pupil behavior.. 
She or he maintains this environment with little apparent effort or expression 
of negative affect. . ^ 

Individual Attention . It was noted at the beginning of this section that 
the effective teacher of low socioeconomic status pupils in Grade III and below 
sets pupils to work in small groups or as Individuals (seatwork) less of the 
time than the ineffective teacher does, and spends more time working with them 
all in one large group. The effective teachers 1 pupils do spend some time in 
seatwork or "Independent" study; but their teachers behave differently during 
this time than ineffective teachers. For one thing, they spend more time 
checking individual pupils 1 work (25); for another," they are less perfunctory 
when they do so (26). Evidence from two studies (BTES, BE) indicates that, 
even though their pupils may spend less time 1n seatwork, effective teachers 
spend more of their time working with individual pupils, and are more likely 
to have Initiated the contact themselves. 

An Interesting point is the Indication (in fable 25) that, 1n the more 
effective teacher's classroom, the proportion of teacher-Initiated contacts 
with pupils that relate to lesson content 1s neither higher nor lower than it 
is 1n the classes of less effective teachers, but somewhere between (BE). The 
teacher who hardly ever speaks to a pupil about anything but class work 1s 
not the effective one; nor is the teacher who spends too much time in nonsub- 
stantive conversation (of. Table 42). The effective teacher seems to know 
how much 1s enough. 

When the effective teacher does talk to.an individual pupil, two studies 
(BE, S73) agree that she or he tends to talk longer, to pay closer attention 
to the pupil than the less effective teacher (26). 

y ^ 

The general picture these data convey is clear. When the effective^ 
teacher's pupils work independently, the teacher activity supervises -them f «.y 



giving careful attention to those Individual children who, 1n the teacher's 
opinion, need 1t. The Ineffective teacher who assigns pupils to seatwork 
leaves them Rretty much to themselves; anyone who. needs help must seek 1t. 

Evidence about teacher mobility (27) would seem to be related to this r 
area, but what evidence there 1s 1s not consistent. One study (SK) reports 
that the more effective teachers move about more than less effective ones, 
which seems consistent with what we have found. But another study (BTES) 
reports that effective teachers (of arithmetic, at least) spend more time 
at their desks than Ineffective ones. A third study (WGC) reports that the 
competent teacher is more aloof and detached than the less ^competent teacher. 

One way of reconciling these findings would be to Interpret them as 
grade related— as Indicating that the effective third grade teacher moves 
about a lot, while the effective second grade teacher sits at the desk looking 
aloof and detached. Needless to say, such a conclusion needs verification 
before 1t 1s taken very seriously, since the different grades were' observed 
1n different sites. The conflicting evidence that effective teachers work 
with Individuals both closely and often has ,peen verified 1n different sites 
and demands to be taken seriously. 

The evidence regarding the effects of Individual attention on pupil 
attitudes. 1s mixed. The behaviors that are more common where pupils 1 attitudes 
toward school are favorable are: teacher checking pupil work (25, BTES) and 
teacher aloof * detached from pupil activities (27, WGC)— both observed in the 
second grade. 



Teacher Competence and Pupil SES in the Primary Grades 

A question that has Important Implications for teacher education is 
whether the same patterns of behavior are effective in classes made up mainly 
of pupils of low socioeconomic status and 1n classes of pupils made up of high 
socioeconomic status. We do not have much Information on this point because 
only one of the studies used 1n this review obtained comparable data 1n classes 
of both types. There are, howeyer, a surprising number of instances (62% Of all 
pairs) in which a process-product relationship reverses between the two types 
of classes—that 1s, instances in which the ineffective teacher in one^group 
behaves Hke the effective teacher in the other. 

Such reversals cannot be verified in other studies as the relationships 
reported in the last sections could; on the other hand, any such reversal reported 
/in one~of 'the tablesjs statistically significant beyond the .01 level, and 
represents a difference of at least .78 between the two correlations involved. 
We have found such reversals in two areas— one Related to the conduct of class- 
room discussion, and the other related to teacher attention to individual pupils. 

z 

Conduct of Discussion . Effective teachers 1n high SES classes are most 
likely to use -one of the two following questioning patterns: 1 (1) to Identify 
the pupil who 1s to answer a question before asking 1t, or (2) to ask a question 
and then call on a pupil who Indicates a desire to answer the question. Effec- - 
tlve teachers 1n low SES classes are most likely to use a third strategy— to 
ask a question first, and then choose a respondent who probably has not Indicated 
a= desire to answer the question (29). 

7 

\ 

> 

\ 

i 

i 



19 



3 7 



In a high SES class taught by an effective teacher, the pupil 1s more 
likely to answer Incorrectly than a pupil 1n a low SES class taught by an 
effective teacher (17). 

Once the pupil has answered, the effective teacher 1n the high SES class 
1s more likely to discuss the pupil 's answer than. the effective teacher 1n the 
low SES class (21)— unless the aoswer -Is Incorrect. 

If the pupil's answer 1s Incorrect, the effective teacher\1n the high SES 
class is more likely either to criticize the pupil's answer or. to answer the 
question personally than the effective teacher in the loH^ES^class.^^). 

If the pupil falls to answer, the effective teacher 1n the high SES class 
is lees likely to give him or her another chance to respond (by repeating or . 
rephrasing the question or asking a new question) than the effective teacher 1n 
the low SES class (24). 

If the pupil says he or she does not know the answer, the effective teacher 
. in the high SES class is more likely to call on someone eUe than the effective 
'^teacher in the low SES class (24). 

In summary, the relationships just discussed seem to indicate two distinct 
discussion strategies. 

In Strategy I, the questions tend to be difficult and to require the pupil 
to think; and the teacher tends either to Indicate jvho 1s to answer the question 
before asking it, or to let a volunteer respond. . If the answer is incorrect, 
the teacher 1s likely to be critical of 1t or to give the answer. The pupil 
Who fails to answer or doesn'-t know the answer 1$ not likely to get a second 
opportunity; the teacher will give someone else a chance to answer 1t. The 
teacher who uses this strategy successfully seems to be challenging pupils to . 
respond near their highest level of capability. 

Strategy I seems to be appropriate 1n classes made up of high^SES pupils 
but inappropriate in classes made up of low SES pupils. 

In Strategy II, the questions appear to be simple ones, since they elicit 
responses that are usually correct and seldom merit further discussion. The 
teacher is likely to raise a question first and then to indicate who is to 
^answer it, possibly as a way of holding pupils 1 attention. The teacher seems 
to choose a respondent likely to get the right answer, since wrong answers are 
relatively infrequent. Criticism of a pupil's answer is rare, even when it 1s 
incorrect; and if a pupil fails to answer or does not know the answer, the 
teacher is more likely to help out (perhaps by rewording the question, or 
perhaps by asking an easier one) than to turn to another pupil. The teacher 
who uses Strategy II appears to be more concerned with gtylng pupils a chance 
to experience success than to challenge them withj^lj^rcult questions. 

Strategy II 'is used by effective teachers^Tn cfasses made up mainly of 
low SES pupils and by Ineffective teachers 1n classes of high SES pupils. 

It should be remembered that thes.e ^findings cdme'Trfcm one study (BE)* and;, 
have not been verified elsewhere .as yet. 
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Attention to Individual Pupils . There are a few contrasting findings in 
the tables (all from BE) which suggest that how much attention a competent 
teacher pays to individual pupils also depends on SES. We noted in the last 
section of this report that the effective teacher of low SES pupils tends to 
pay more and closer attention to individual pupils during seatwork and small- 
group activity periods than the ineffective teacher does. 

There is evidence that this relationship may reverse in classes in which 
most pupils are of high SES. It is the less effective teachers in these. classes 
who accept a higher >proportion of pupil attempts to initiate work contacts (15), 
who initiate a higher proportion of private contacts related to arithmetic (25), 
and \vho are most likely to give long feedback during teacher-initiated work 
contacts (26). 

As far as they go, these findings indicate that the teacher who gives the 
most individual attention to pupils in high SES classes is the one who is least 
effective in producing cognitive gains, and that the reverse is true in low SES 
classes. 

Concluding Remarks. In this section we have examined the tables for 
evidence about whether the nature of competent teacher behavior depends on the 
SES of the pupils being taught. We did so in_part to illustrate a way of ustyig 
the tables that is different from the one illustrated in the preceding section. 
In the earlier section, we looked for consistencies across studies; one might 
say that we exploited similaritjes in the relationships. lathis section we : 
have exploited differences in relationships within a single study. The formed 
approach leads to results that are much more impressive—harder to question— 
than those obtained in this section. The kind of findings obtained in this 
section are neither as obvious nor as impressive, but are not to be dismissed 
lightly, since each difference reported is so great. 

_ If they are accepted as read, these findings have clear Implications for 
teacher educators, for researchers, and for educators. For teacher educators, 
they strongly suggest that teacher education students may need to learn very' 
different strategies for dealing with pupils from different backgrounds, at 
least 1n these earlier grades. 

For the, researcher, they Indicate a great need for further study of how 
optimal teaching strategies vary with the setting 1n which the teacher works. 
Much more could have been learned about these matters from the various studies 
of Follow Through (SK) and from Beginning Teacher Evaluation Study (BTES) 1f 
the samples had been chosen to represent both SES levels, and if the two types 
of students had been Isolated in the analysis. And the increase 1n cost would 
have been negligible. 

The implications for the public schools might be the most far-reaching of 
all. If there are many strategies which have opposite effects on pupils of 
these two types (or any others), 1s it fair to the pupils (or to the teachers) 
to mix them together 1n the same classroom? tfore findings like these .would 
indicate a negative answer. 



21 34 



Competent Teacher Behavior in the Upper Elementary Grades 

jfhere has been much less reviewable research done in grades above the % 
third, and making sense of, what there is calls for more imagination or ingenuity. 
Following are the principal 1 differences we find between effective and ineffective* 
teachers in these grades. Ignoring pupil SES. 

.0 The effective teacher in upper elementary grades talks more (13, S66, Sp; 
28, WGC).; keeps- pupils on task more (36,^ WGC, BTES); and is less permissive 
(37, WGC; 43, WGC, SoK), although the pupils do initiate more interchanges 
than those in classes taught tfy less effective teachers (14, WGC, f v G) # The 
effective teacher's questions tend to be easier and of a lower cognitive level, 
however (17, 22, 40, GG; 19, WGC; 20, S66; 21, WG£). The picture that emerges 
1s one 1n which the teacher presents most of the content, with low-level teacher 
questions and pupil questions interspersed. 

The effective teacher manages the upper elementary classroom with less 
effort and is more selective in use of rebukes or criticism (31, 33, WGC; 34 3 
WGC, Sp, GG; 35, WGC, BTES). During seatwork, upper elementary pupils in- 
effective teachers 1 classrooms are more likely to approach the teacher* and 
the teacher is less likely to approach the pupils (25, GG); and teacher? attend - 
pupils less closely (26, WGC), which suggests more pupil autonomy. There is 
also some indication that more effective teachers favor less traditional 
materials (11, WGC, BTES). i\ 

Inspection of relationships to affective gains indicatejiia^-pupil?. 1 
self-concepts improve in the classes ^ where; cognitive levef is 1:^(18) and 
where management is unobtrusive (33/34, ~35), and that attitudes": toward school 
are also high where the latter competence is displayed. -> 

In sur.mary, the picture we derive of the effective teacher In these grades 
1s rather traditional and, let's face 1t, unexciting. .These implications are" 
not nearly as well supported as those drawn about teachers of low SES pupils ' 
in grade three and below. Most. of them are based on results from more than 
one study, however, unlike the conclusions w6 drev; above about differences 
between low and high SES classes. Those should be viewed as tentative at best. 

Concluding Remarks 

The reader should bear in mind that these attempts to interpret some of the 
findings in Tables 3-43 are to be regarded as of secondary importance. The 
facts shown in the tables are the primary product of this study, and we would 
prefer that the value of -the study be judged according to their usefulness 
rather than on the merits of our Interpretations of them. If we have succeeded 
1n providing easier access to some of the strongest findings of the research in 
teacher education, we have done what we set out to do. 

If there 1s one conclusion that we would like the reader to share with 
us, It is the conclusion that fairly leaps from these pages: where sufficient 
effort and resources have been applied to the study of teacher effectiveness, 
useful and dependable findings have emerged. This approach to the study of 
teacher- effectiveness does work, and we need more of it. 
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Table 3 - GROUP SIZE 



BEHAVIOR ITEM 



GRADE 




Adult with large group of pupils-general 

Adult with large group of pupils- 
arithmetic 

Adult with large group of pupils- . 
reading 

Teacher, aide, or any adult with 
small group of pupils 

Small group with teacher (arithmetic) 

Small group with ar\y adult (arithmetic) 

Adult (other than teacher) working with 
(small) group 

Small group with teacher, aide, or any 
adult (reading) \ 



ERIC 



LOW SES PUPILS 



REAOING 
CAINS 



U — 7H 



H- H 



H H 



L L 



L L 



ARITHMETIC. 
GAINS 



AFFECTIVE 
CAINS 



L L- 



nr" h 



H H 



H H 



H 1 H 



HIGH SES PUPILS 



READING 
CAINS 



ARITHMETIC 
CAINS 



AFFECTIVE 
CAINS 



SOURCE 
SYMBOL 



SK89 et al. 

SK 123,135 

SK 146,158 

SK 106,88, 
94 

SK 122 

SK 134 

BTES AP 



SK 157,145, 
149 • 
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Table 4 - SHALL GROUP WITHOUT ADULT 



ERLC 



BEHAVIOR ITEM 



GRADE 




Pupils work without teacher— 
seatwork, parallel or Instructional 
group 

Pupils work without teacher— 
seatwork, parallel or Instructional 
group 

Hours of Instructional learning 
without teacher vs* hours of 
structured learning with teacher 

Small group working Independently 
(arithmetic) ( 

Two pupils working Independently 
(arithmetic)/ 

Two pupils v/orklng Independently 
(reading) 



II 

K,II 
III 
III 

* III 



\0W ^SES * PUPILS 



READING 
GAINS 



Ll L2 
Ll L2 

L 



aaithmetic 

SAINS 



Ll L2 

Ll L2 

Ll L2 

L L 

L L 
L 



AFFECTIVE 
CAMS 



H L 



HIGH 


SES 


READING 


ARITHMETIC 


GAINS 


GAINS 


CO»p.exUy 


cmpUnity 


low high 


\m hlfh 




AFFECTIVE 
GAMS 



SOURCE 
SYMBOLs 



S73 FLA6 

S73 FLA6 

S73 C0R3 
SK 138 
SK 137 ' 
SK 160 
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Table 5 - SEATWORK i 



- 




LOW 


SES PUPILS 


-HIGH 


se: 


PUPILS ' 




BEHAVIOR ITEM 


GRADE 


READING 

GAIKS 

complexity 
low high 


ARITHMETICS 
, i. GAINS 

complexity 
Iom high 


AFFECTIVE 
GAINS 

school self 


READING 

GAINS 

complexity 
low high 


ARITHMETIC 

- GAINS 

^complexity 
low high 


AFFECTIVE 
GAINS 


i * 

SOURCE 
SYMBOL 


Activity: seatwork 


II • 


0 






0 






BTES R15 


Pupil self-directed and task oriented 




0 


L2 




; 0 






WGC FLACCS 


All pupils work on same task at same 
time, are responsible for same assign- 
ments, no individualized assignments 




0 


0 . 


L 








S73 TP4 


All pupils working independently 
(arithmetic) 


III 




L' 


H L 








SK 142 


Teacher assigns large amount 
of seatwork 


II-III 


H 












BE 18 


Teacher Individualizes assignments 






Hi 






Hi 

1 

* J 

\ 




WGC TP! 7 

s 



e 6 - ACADEMIC TIME 



BEHAVIOR ITEM 

Structured vs. unstructured time 

Total academic verbal Interactions 

Structured learning with .teacher 

Total academic verbal Interactions 

Percent of observations in which an 
academic activity is occurring 

Total class duration 

Unoccupied child 



GRADE 

I-II 
I 

II 
III 

III 
III 
III 



LOW SES PUPILS 



READING 

GAINS 

complexity 
I* high 

Hi H 2 
H 

0 H2 



ARITHMETIC 
GAINS 

coMplexlty 
Vou high 

hi h 2 

H H 
L 1 H 2 
H H 

H H 
H H 
L L 



AFFECTIVE 
GAIKS 



school self 



HIGH 



SES PUPILS 



READING 

GAINS 

complexity 
low high 



ARITHMETIC 

GAINS 

complexity 
Ioh high 



AFFECTIVE 
GAINS 



SOURCE 
SYMBOL 

S73 CDR6 
SK 435a 
S73 CDR3 
SK 566c 

SK 242 
SK 17 
SK 77 



Table 7 - TIME SPENT ON READING 







I 0 w 


SES PUPILS 


n i van 






>• 


BEHAVIOR ITEM 

i 


GRADE ' 


READING 
GAINS 


ARITHMETIC 
GAINS 


AFFECTIVE 
GAINS 


READING 
GAINS 


ARITHMETIC 
GAINS 


AFFECTIVE 
GAINS 


SOURCE 
SYMBOL 






complexity 
lew high 


caapleilty 
low - high 


school self 


complexity 
low high 


coopltxity 
low high 






Reading activities (self report) 


I 


II 












CRAFT 


















log 


Reading, alphabet, language devel- 
opment activities 


I 


H H 












SK 67 


Number of pup* Is Involved 1n reading 


I 


H H 












SK 163 


Reading, alphabet, language devel- 
opment activities 


III 




H 










SK 67 


iiuiMDer or pup lis involved in reading 


T T T 
III 




H ■ H 










SK 163 


Time teacher spends preparing and 
teaching reading (self report) 


II 


0 L2 






0 L* 


t 




BTES WD1 


Total reading time (self report) 
(Phonovisual method) 


II 


L 












CRAFT 
log 


Time teaching decoding skills 
in reading (self report) 


V 


L 1 






L 1 






BTES WD2 











\ 
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Table 8 - TIME SPENT IN READING-RELATED ACTIVITIES ' T ~ S 

( 







LOW 


SES PUPILS 


HIGH 


SES 


PUPILS" 






BEHAVIOR ITEM 


GRADE 


READING 

CAINS 

complexity 
lot) htgN 


ARITHMETIC 

CAINS 

complexity 
low high 


AFFECTIVE 
CAINS I 

school telf 


READING 
r true 

complexity - 
low 1il9h 


ARITHMETIC 

GAINS 

coapltxfty 
to* high 


AFFECTIVE 
GAINS 

school self 


SOURCE 
SYMBOL 




Supportive rate (self report) 


I 


H 












CRAFT log 




Supportive activities (self report) 
(Language experience method) 


II 


L 












CRAFT log 




Listening to stories (self report) 
(Phonovlsual method) 


I 


H 












CRAFT Ion ■ 




Listening to stories (self report) 
(Language experience method) 


II 


L L 












CRAFT log 




Listening to poetry (self report) 
(Basal reader method) 


II 


H 












CRAFT log 




Percent of time 1n spelling 


II-III 








M M 


M 




BE 5(T4) 




Percent of time in language arts 
» 


II-III 




L 






L- 




PF 2(T4) 





47 



48 



Table 9 



- TIME SPENT ON ARITHMETIC 



BEHAVIOR ITEM 



Numbers, mathematics, arithmetic 
activities 

Number^of "pupils involved in 
arittfnet'ic 

Frequency, of teaching operation 
skills in arithmetic (self report) 



GRADE 



III 
III 
II 



LOW SES " PUPILS 



READING 
GAINS 

coapttxtty 
1m Mgh 



ARITHMETIC 
GAINS 

complexity 
low high 



H H 
H H 
Hi H2 



AFFSCTlVE 
GAlftS 

school self 



* 



HIGH SES PUPILS 



. READING 

GAINS 

complexity 
low high 



ARITHMETIC 

GAINS 
complexity 
low high 



Hi H 2 



AFFECTIVE 
GAINS 

school Sftf 



SOURCE 
•SYMBOL 



SK 66 - 
SK 140 

btes ud 



Table 10 - TIME SPENT IN OTHER SUBJECTS 



BEHAVIOR ITEM 



GRADE 



LOW SES PUPILS 



HE AO IMG 
GAINS 

complexity 
low high 



ARITHMETIC 
GAINS 

complexity 
;ow high 



AFFECTIVE 
GAINS 

school self 



HIGH 



SES . PUPILS 



READING 

GAINS 

complexity 
1o* high 



ARITHMETIC 

GAINS 

complexity 
low high 



AFFECTIVE 
GAINS 

school self 



SOURCE 
SYMBOL 



Art work with reading (self report) 
Total science time (self report) 
otal social studies time (self report) 
Percent of time in social studies 
Percent of time in art 
Group time 

Story, music, dancing activities 



II 
II 
II 

II-III 
II-III 
III 
III 



\ 



u — 



\ 



L 

H H 
H 



L 

L L 



CRAFT log 
CRAFT log 
CRAFT log 
BE 7 (T4) 
BE 4 (T4) 
SK 62 
SK 63 



Table 11 - READING MATERIALS 




Use of basal reader other than -state 
adopted {self report) 

Use of books, etc. (secondary) 

Hide range of Informative 
Materials available 

Use of games (self report) 

Hide range of Informative 
materials available 

Use of.workbook other than 
basic (self report) 

Use of board, etc. (secondary) 



II 
II 

II 
II 



III-VIII 

V 
V 



L 1 

Hi H2 

0 
0 



0 
0 



H2 



H* 



0 
Hi H2 

• 1 



0 
0 



H* 



\ 



BTES HO 
BTES Rll 

HGC TP4 
BTES HO 



HGC TP4 

BTES HO 
BTES R12 
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Table 12 - ARITHMETIC TEACHING MATERIALS 



> > 


- 


LOW 


SES ' PUPILS 


HIGH 


SES 


PUPILS 




BEHAVIOR ITEM 


GRADE 


REAOtNC 
SAINS 

ccapltxlty 
leu high 


ARITHMETIC 
* SAINS 

coapltxtty 
Tow fclfh 


* -r 

affective 
quns 

scliool self 


READING 

GAINS 

complexity 
1* h1o,h 


ARITHMETIC 

GAINS 
capltxlty 
low high 


AFFECTIV£ V V 
GAINS 

school stlf 


SOURCE 
\ SYMBOL 


Use of programmed materials (self report) 
...teacher-made materials (self report) 
'...Individualized materials (self report) 


II 
II 
II 




Hi H2 
H 1 






»] < 

Hi H2 
Hi 




BTES WD 
BTES WD 
BTES WD 


Games 


II 




Ll 






Ll 




BTES R19 


G#me$, toys, play equipment present 


III 




L L 










SK 25 


Audio-visual equipment present 


III 




L L 










SK 37 


Audlo-vfsual equipment used 


III 




L 










SK 38 

* 


i 

i 

\ 

\ 



















Table 13 - STEADY-STATE TEACHER TALK 




Steady-state teacher talk vs. 
pupil talk 

> 

Teacher tells story, pupils 
attentive, Interested 

Steady-state teacher talk vs. 
pupil talk 

Teacher lectures, pupil s 'bored 



Extended teacher talk and inquiry 
vs. drill 

Buslness-Uke lecture method, 
Insistence on attention to tasks 
and conformity 



I 

II 

II 
II 



III-VI 



IV, VI 



0 

0 L2 
Hi H 2 



L! L 2 



Hi H2 



H H 



S73 RCS5 

WGC CS1 

S73 RCS5 
WGC CS2 



S66 F3 



Sp F6 



■ 

57 



Table 14 - PUPlL INITIATIONS 



* 




LOW 


SES 


PUPILS 


HIGH 


SES 


pupils" 






BEHAVIOR ITEM 


GRADE 


READING 

GAINS 

complexity 
low high 


ARITHMETIC * 
GAINS 

complexity 
low high 


AFFECTIVE 
GAINS 

school self 


READING 

GAINS 

complexity 
low high 


ARITHMETIC 

GAINS 

complexity 
low high 


AFFECTIVE 
GAINS / 

school self 


SOURCE 
SYMBOL 




Pupil -initiated vs. t«»acher-initiatpd 
Interchanges 


i 






L 1 










WGC OScAR 




4jup1l-1n1t1ated Interaction vs. 
response to teacher 


i-n 




ll 

/ 










\ 


S73 RCS1 




Pjupll Initiates substantive 
Interchange 


ii 




L 1 








Ll 




WGC OScAR 




Pupils speak freely 


TT 
1 1 


il 

L 








L 




/ 


WGC OScAR 




Pupil task-related cornnents 
to adults 


III 




L 










{ 


SK 388a 




Pupil questions, requests, 

v*ui|iiK*i luo" lui i^a^aucJii l L 


T T T 
111 




L 


L 










SK 477c, 
346a 




All nnn— pPQnnnQ A vo nun41 
nil iiuii— i cofJUio i vc pup 1 1 

utterances to adults 


III 




L 


L 










SK 343a 




Pupil Initiates substantive 
Interchange 


III-VIII 






H2 






Hi H2 




WGC OScAR 




Pupil volunteers Information vs. 
pupil asks for Information 


III-VI II 


..1 








H' 






WGC OScAR 




Total pupil -Initiated contacts 


IV 












H H 




GG 




Pupil -Initiated vs. teacher-initiated 
substantive Interchange 


IX-XII 


Hi 








Hi 






WGC OScAR 





Table 15 - TEACHER ENCOURAGES PUPIL PARTICIPATION 



1 




LOW 


SES PUPILS 


HIGH 


SES 


PUPILS 






BEHAVIOR ITEM 


GRADE 


GAIKS 


ARITHMETIC 
GAINS 


AFFECTIVE 
CAINS 


READING 
GAINS 


ARITHMETIC 
GAINS 


AFFECTIVE 
GAIKS 


conorc 
• oUUKLt 

SYMBOL 








complexity 
low high 


caaplixlty 
low hlati 


school self 


complexity 
low high 


caaplixlty 
tot high 


school self 




Teacher listens to pupils and 
provides feedback 


II 








Ll 






W6C FL27 




Teacher pauses, asks' for questions, 
and answers them before proceeding 


II 








Ll L2 






W6C FLA 




Short feedback on pupil question 


II-III 


L 


H 




L 


H 




BE L83 




Teacher gives long feedback on 
pupil question 


■ II-III 


L 


L 




L 






BE L84 




Teacher praises pupil opinion 
question 


ii-nr 


H 












BE Q126 

► 





TT.3 



Table 16 - NUMBER OF TEACHER QUESTIONS 



- 




LOW- 1 


SES PUPILS 


HIGH 


SES 


PUPILS 






BEHAVIOR ITEM 


GRADE 


READING 
CAMS 

complexity 
1o» high 


ARITHMETIC 
GAINS 

coap.ltxity 
lex kifh 


> AFFEQIIVE 
GAINS 

school self 


READING 

GAINS 

complexity 
low high 


ARITHMETIC 

GAINS 

co^lcxHy 
low high 


AFFECTIVE 
GAINS 

school self 


k oUUKLt 
SYMBOL 




Pupil responses, academic 


I 


H 


H H 










SK 360a, 
491c 




Ratio of total opportunities pupil 
has to respond to total time 
(arithmetic) 


II-III 


L 






H 


H 




BE T169 




Group response to question, 
command, etc. 


III 


H 


H H 










SK 363a 




Pupil responses, academic 


III 




H H 










SK 360a t 
491c 


* 


'Pupil responses, total 


III 




H 










SK 358a 




Direct academic questions, requests, 
commands 

• 

• 

\ 

\ 

> 


III 




H H 

i 










SK 353a, 

451a, 

582c 





V 



Table 17 - PUPIL RESPONSE TO TEACHER QUESTIONS 



erJc 



BEHAVIOR ITEM 



Percent correct 
Percent Incorrect 
Percent no response 
Percent don't know 



Number wrong 
No response . 
Percent correct 



GRADE 




II-III 
II-III 
II-III 
II-III 



IV 
IV 
IV 



LOW SES PUPILS 



READING 

GAINS 

complexity 
liw high 



H 

L L 



ARITHMETIC 
CAINS 



H 

L L 
L 

H 



AFFECTIVE 
GAINS 



HIGH 



SES PUPILS 



READING 
GAINS 



H H 



ARITHMETIC 
GAINS 



L L 
L L 
H H 



AFFECTIVE 
GAINS 



SOURCE 

• SYMBOL 



BE C7 
BE C9 
BE C11 
BE CIO 



GG 
GG 
GG 



Table 18 - LOW COGNITIVE LEVEL QUESTIONS 



\ 

\ 



• 




LOW 


SES 


PUPILS 


HIGH 


SES 


PUPILS . 






BEHAVIOR ITEM 


GRADE 


READING 
GAlftS". 
complexity 


MITHftJTIC 

GAINS 

coaplt>tty 
law M«h 


AFFECTIVE 
CAINS 

tchool ttlf 


HEADING 
GAMS 
" cooplc «Uy 

1 j^. 1*4 nit 

low mjn 


ARITHMETIC 

WHS S> 

CMpliiity 
low Mfth 


AFFECTIVE 
•* GAINS 

- » . .1/ 

scnooi $ci< 


SOURCE „ 
SYM801 




Convergent teaching— teacher central , 
low-level questions, quick response, 
feedback 


MI 


H 1 H2 


Hi 


H* 


/. 

f 1 








S73 TP1 

&t & III 




Narrow questions, drill, pupil 
response 


I 


Hi 


Hi 












S73 RCS3 




Questions calling for translation, 
Interpretation 


K-I 


Hi 




Hi 










S72 TCB3 




Questions calling for Interpretation 


K-I 


H 1 


H 1 












S72 TCB1 




Narrow questions, Immediate 
feedback 


II 


Hi H 2 






L3 


Hi H2 




L3 


HGC TP23 




Direct academic questions, 
requests, conmands 


pi 




H 


H 










• 

SK 451a, 
582c ,353a 




Percent of substantive questions 
that offer limited choice of 
answers (yes-no, etc.) 


IMII 




L 








H . 




BE B6 




Recitation (low-level questions, 
quick feedback, narrow focus) 


V ' 


Ml 




H2 


h' • 




„2 ■ 


; S73a FIT 





\ 



68 



Table 19 - HIGH COGNITIVE LEVEL QUESTIONS 







, LOW 


SES PUPILS 


HIGH 


SES 


PUPILS 




BEhWIOR ITEM 


GRADE 


READING 
GAIKS . 

complexity 
low high 


ARITHMETIC 
GAINS 

conplexlty 
lax high 


AFFECTIVE 
GAINS 

school self 


READING 

GAINS 

complexity 
low Mah 


ARITHMETIC 

GAINS 
conplexlty 
low high 


^ 

AFFECTIVE 
GAINS 


SOURCE 
SYMBOL 


Broad answers vs. narrow ones 


K-I 


L 1 


1 

L 










S72 TCB2 


Open questions and pupil self- 
evaluation and free Inquiry vs. 
closed, text-oriented questions, 
teacher evaluation 


I-II 


0 


L 1 










S73 TP7 


Concept attainment 'by 
discovery method 


II 


0 






0 






WGC CS8 


Teacher avoids causing pupil 
doubt or uncertainty 


III-VIII 

• 


Hi 




H2 


Hi 




H2 


WGC TP6 



7 0 



Table 20 - TEACHER REACTION TO PUPIL RESPONSE-GENERAL 



• 




LOW 


SES PUPILS 


HIGH 


SES 


PUPILS 




BEHAVIOR ITEt-lX^ 

\ 


GRADE 


READING 
GAINS 

complexity 
1m high 


ARITHMETIC 
GAINS 

complexity 
low hl»h 


AFFECTIVE 
GAINS 

school 'self 


READING 

GAINS 

complexity 
low high 


ARITHMETIC 
GAINS 

low high 


AFFECTIVE 
GAINS 

school self 


SOURCE 
SYMBOL 


Total feedback (academic) 


I 


H » H 


H H 






s 




CEf AT 0% 

oK < H&a» 
543c 


Positive corrective feedback 
(academic) 


I 




H H 


• 








SK 406a 


A*ks new question 


II-III 




H H 




L 






. BE J69 


Repeats question 


II-III 


L L 






H H 


L 




BE SI 63 


Acknowledaement ta^k-rplatprt 
non-academic 


III 




L 










SK 397a 


No feedback {when answer 1s correct) 


II-III 


H 


L 




H 


• 

L 




BE D14 


Rephrases question or gives clue 


II-III 


H H 


M 




M 


H 




BE SI 64 


Criticism 


III-IV 










L L 




S66 Fl 


Non-evaluative 


. V 


L 1 L2 






L 1 L 2 




* 


RTFS AP 



Table 21 - TEACHER REACTION TO PUPIL RESPONSE— AMPLIFICATION, EXTENSION 




BEHAVIOR ITEM 



Teacher uses pupil Ideas, probes 

Teacher responds to pupil & amplifies 

Teacher discusses pupil answer (total) 

Teacher discusses correct answer 

Teacher discusses wrong answer 

Teacher helps pupil correct 
mlsperceptlon 



GRADE 

K-I 
II 

II-III 
II-III 
II-III 

II 



Teacher helps pupil correct 
mlsperceptlon 



III-VIII 



LOW SES PUPILS 



READING 

GAINS 

complexity 
low high 



ARITHMETIC 
GAINS 

complexity 
low high 



AFfECTlVE 
GAINS 

school self 



HIGH 



SES PUPILS 



READING 

GAINS 

complexity 
low high 



Hi 



ARITHMETIC 

GAINS 

complexity 
low high 



AFFECTIVE 
GAINS 

school self 



Hi 



SOURCE 
SYMBOL 



Perham 
S73 RCS2 
BE J68 
BE D15 
BE F31 

WGC TP8 



WGC TP8 



73 



9 

ERLC 



71 



Table -2r2 TEACHER REACTION TO WRONG ANSWER 







LOW 


SES PUPILS 


HIGH 


SES 


PUPILS 






BEHAVIOR ITEM 

• 


GRADE 


READING 

GAINS 

complexity 
low high 


ARITHMETIC 

GAINS 

complexity 
low high 


AFFECTIVE 
CAINS 

school self 


READING ' 

GAINS 

complexity 
lx high 


ARITHMETIC 

GAINS 

cwplexfty 
1o» high 


AFFECTIVE 
GAINS 

school setf 


SOURCE 
SYMBOL 




Repeats, rephrases, or asks new 
question 


IMII 


M H 


M M 




M 


H H 




BE F35, 
36,38 




No feedback 


IMII 


L 












BE F30 




Gives the answer 


IMII 


L L 


L M 




H 






BE F32 




Criticizes 


IMII 


L L 


L L 




H H 


L H 




BE F29, 
J66B 




Negates (neutral rejection) 


IV 










L L 




GG 



7o 76 

Or 



Table 23 - TEACHER REACTION WHEN PUPIL RESPONSE IS PART CORRECT 



BEHAVIOR ITEM 



Gives the answer 

Calls on someone else 

Asks a new question 

Rephrases or gives clue (morning) 

Repeat, rephrase, or ask new 
question 



77 



GRADE 



I-III 
I-III 
I-III 
I-III 

I-III 



LOW SES PUPILS 



READING 

GAINS 

csapltxlty 
1m high 



H H 
M 

H 
H 

L H 



ARITHMETIC 
GAINS 

caapltxlty 
jaw Mjh 



AfFECTIVE 
CAINS 

school self 



HIGH 



SES PUPILS 



READING 
GAINS 

conpltxfty 
low Mgh 




ARITHMETIC 

GAINS 

«S*1tx1ty 
low hf»h 



L 
W4 



AFFECTIVE 
GAINS 

school s*1f 



SOURCE 
SYMBOL 



BE E21 
BE E22 
BE E27 
BE E26 

BE E24 



/Table 24 - TEACHER REACTION WHEN PUPIL FAILS TO ANSWER QUESTION OR SAYS "DON'T KNOW" 



BEHAVIOR ITEM 



GRADE 



Repeats, rephrases, or asks new 
question 



Rephrases (or gives clue) 

Repeats question 

Another pupil, calls out the 
answer 

Calls on another pupil (no answer) 
Calls on another pupil (don't know) 
Gives the answer 
Criticizes 



LOW SES PUPILS 



READING 
GAINS 

complexity 
low high 



H M 
H 

H 

H 

M 

L L 



ARITHMETIC 
GAINS 

complexity 
low Mgh 



H H 

L 
M 

M H 
M M 



AFFECTIVE 
GAINS 

school self 



HIGH 


' SES 


PUPILS 


READING 


ARITHMETIC 


AFFECTIVE 


GAINS 


GAINS 


GAINS 


complexity 


complexity 




low high 


low high 


school self 



H 
L 

L 
H 

H 

H ! 



L L 

H 
L 



H H 



H H 



SOURCE 
SYMBOL 



BE 163, 
G44 

BE 164 
BE SI 63 

BE G43, 
J74 

BE J73 
BE G42 

JE-G41 

BE G39 



79 



Table 25 - TEACHER WORKS WITH INDIVIDUAL PUPIL 



BEHAVIOR ITEM 



GRADE 



LOW SES PUPILS 



READING 
GAIKS 

complexity 
jog hloh 



ARITHMETIC 
GAIKS 



complexity 
low high 



AFFECTIVE 
GAINS 

school self 



HIGH 



SES PUPILS 



READING 

GAINS 

complexity 
low high 



ARITHMETIC 

GAINS 

complexity 
la* high 



AFFECTIVE 
GAINS 

school self 



SOURCE 
"SYMBOL 



Teacher checking pupil work II 

Teacher-Initiated dyadic contacts 

per unit of teaching time (reading 

groups) H-III 

Proportion of teacher-Initiated 
contacts that relate to class work II-III 

Percent of time pupil works alone 

with teacher (arithmetic) II 

Proportion of arithmetic contacts 

that are teacher-1n1t1ated, private II-III 

Proportion of pupil -Initiated 

work contacts accepted II-III 



Ratio of teacher-1n1t1ated contacts 

to pupil -Initiated contacts IV 

Pupil -Initiated work contact with teacher 
feedback IV 



H M 



H 

H H 



H* 



H L 



Hi 



H2 



L H 



L L 
L L 



M 

Hi 

L L 
H L 



L L 
H H 



BTES AP 

BE U170 
BE P146 
BTES AP 
BE TI67 
PE N105 



GG 
GG 



\ 



Table 26 - CLOSE ATTENTION TO PUPILS 







LOW 


SES PUPILS 


HIGH 


. SES 


PUPILS 




RFMAVTOR TTFM 


GRADE 


READING 
GAINS 

complexity 
jM high 


ARITHMETIC 

r* f hc 
bAlfld 

complexity 
low high 


AFFECTIVE 
GAINS 

school self 


READING 

CAINS 

complexity 
low high 


ARITHMETIC 

CAINS 
complexity 
low high 


AFFECTIVE 
GAINS 

school self 


SOURCE 
SYMBOL 


Proportion of teacher- Initiated work 

rnntart"^ that" Invnlvp ,, mprp M 

observation 


ii-iii 


L 






H 


L L 




BE PI 48 


Long feedback on pupil -Initiated 
work contacts 


ii-iii 


H 






L 






BE 16B 


Proportion of teacher-1n1t1ated work 
contacts that Involve long feedback 


ii-iii 


H 


L M 




L 


L M 




BE PICO 


Teacher attends pupil closely 1n 
task setting 


i 


Hi L*2 


Hi L2 










S73 
FLA8 


Teacher attends pupil closely 


iii-viii 

! 


0 












WGC FLA 



84 



i 



Table 27 - TEACHER MOBILITY 



BEHAVIOR ITEM 



Positive pupil affect and free 
teacher movement 



GRADE 



Adult movement III 

Teacher stays at desk (self report) II-III 

Teacher at desk—working or 

available II 

Teacher aloof, detached from 

pupil activities II 



LOW SES PUPILS 



READING 
GAINS 

complexity 
low high 



H H 



ARITHMETIC 
GAINS 

complexity 
low high 



Hi H2 



H H 



Hi 



AFFECTIVE 
GAINS , 

school self 



HIGH 



SES PUPILS 



READING 

GAINS 

complexity 
low high 



Hi H2 



ARITHMETIC 

GAINS 

complexity 
low high 



Hi 



AFFECTIVE 
GAINS 

school self 



SOURCE 
SYMBOL 



H3 



SK 444a 
BE Q3 

BTES AP 

WGC TP! 6 



S73a F5 



£6 



Table 28 - MISCELLANEOUS TEACHING TECHNIQUES 









LOW 


SES 


PUPILS 


HIGH 


SES 


PUPILS 


r 

\ 




BEHAVIOR ITEM 


GRADF 

Ur\r\UL 


READING 
GAINS 

complexity 
low hl9h 


ARITHMETIC 
GAINS 

complexity 
low hl9h 


AFFECTIVE 
GAIKS . 

sctwo 1 %t\ f 


READING 

GAINS 

complexity 
low Mgh 


ARITHMETIC 
GAINS 

complexity 
low Mgh 


AFFECTIVE 
GAIKS 

tchool self 


SOURCE 
SYMBOL 




Giving and receiving Information 


K-I 




n 




n' 




•J 






S72 TCB 




Giving and receiving Information 


II 


0 


L2 


0 


L2 






T- 




S73 TCB 




naming ^pictures, objects, etc.; 


II 




0 




0 










S73 TCB 




Teacher uses non-verbal 
communication skills 


II 




Hi 






L2 


Hi 


i 


L 2 


WGC FLA 




Visual demonstration 


II 


Hi 










Hi x 






BTES R20 




Games 


II 








0 






0 




BTES R19 




Teacher always gives Instructions 
for follow-up seatwork (self report) 


II-III 




L 








H 






BE 85 




Clear explanations (teacher explanation 
not followed by pupil question) 


III-VIII 






Hi 


H2 






Hi H2 




WGC OScAR 




Teacher uses non-verbal 
conrnunlcation skills 


III-VIII 


0 










0 




! 


WGC FLA 





o 87 



88 



/ 



Table 29 - MISCELLANEOUS TEACHING TECHNIQUES 



BEHAVIOR ITEM 



GRADE 



Variety of Instructional contexts 
(I.e., groupings) 

Class grouped by skill needs 

Class grouped by reading level 

Teacher selects respondent before 
asking question 

Teacher calls on volunteer 

Teacher uses non-patterned turns 

Structuring comments at beginning 
and end of lesson 

Structured learning with teacher 



LOW . SES PUPILS 



READING 

' GAINS 

complexity 
low high 



ARITHMETIC • 
GAINS 

complexity 
low high 



AFFECTIVE 
GAINS 

school itlf 



HIGH 



SES PUPILS 



II 
II 
II 

II-III 
II-III 
II-III 

K-I 
II 



Ll L2 
Hi 

L 

M 
H 

L H 



L3 14 



L L 
Hi 

L H 



READING 

CAINS 

complexity 
low high 



ARITHMETIC 
CAINS 

covtenlty 
\m high 



AFFECTIVE 
CAINS 

school self 



SOURCE 
SYMBOL 



Ll L 2 



H 1 

H 

H M 

. i 



L3 L< 
Ll 



H M 



Hi 



BTES WD4 
BTES WD 
BTES WD 

BE Al 
BE A3 
BE 27 

Perham 

S73'CDR3 ; 



00 



Table 30 - METHODOLOGICAL APPROACH TO THE TEACHING OF READING 



BEHAVIOR ITEM 



GRADE 



LOW SES PUPILS 



READING 
GAINS 

complexity 
low high 



ARITHKETIC 
GAINS 

complexity 
low high 



AFFECTIVE 
GAINS 

school self 



HIGH 



SES 



PUPILS 



RE AO I KG 

GAINS 

complexity 
low . high 



ARITHKETIC 

GAINS 

complexity 
low high 



AFFECTIVE 
GAINS 



school sel 



SOURCE 
SYMBOL 



Using basal reacfers (self report) 
(basal reader method) 



Behavior resembles that of teacher 
using language experience approach 
(language experience, method) 



Behavior resembles that of teacher 
using language experience approach 
with audio-visual enrichment (language 
experience method with audio-visual 
enrichment) 



Behavior resembles that of teacher 
using skills-centered approach (language 
experience method with audio-visual 
enrichment) 



Behavior Implementing language 
experience approach (phono-visual 
method) 



(Continued) 



II 



CRAFT 
log 



CRAFT 
OScAR 



CRAFT 
OScAR 



CRAFT 
OScAR 



CRAFT 
OScAR 



91 



Table 30 - Continued 



BEHAVIOR ITEM 



GRADE 




Behavior resembles that of teacher 
using language experience approach 
(basal reader method) II 



Behavior resembles that of teacher using 
language experience approach with audio- 
visual enrichment (language experience 
method with audio-visual enrichment) II 



Behavior resembles that of teacher 

using .skill -centered approach (basal 

reader method) II 



M1nutes/d*y in phonics activities 

(self report) II 



Usinj expedience chart II 



9-3 



ERIC 



LOW SES PUPILS 



HEWING 
GAINS 



ARITHMETIC 
GAINS 



AFFECTIVE 
GAINS 



HIGH 



SES "PUPILS 



READING 



GAINS 



ARITHMETIC 
GAINS 



AFFECTIVE 
GAINS 



OScAR 



CRAFT 
OScAR 



SOURCE 
SYMBOL 



CRAFT 
OSfcAR 



CRAFT 
log 

CRAFT 
log 



V 



Table 31 TIME SPENT ON MANAGEMENT 



BEHAVIOR ITEM 



Managing behaviors 
Control llng^ behavior 
Time spent 1n transitions 



Number of times when pupils 
line up 



GRADE 



I 

. I 
II-III 

♦ 

II-III 



LOW SES PUPILS 



READING 

GAINS 

complexity 
Ion high 



L L 



ARITHMETIC 
GAINS 

complexity 
low high 



AFFECTIVE 
' GAINS 

school self 



HIGH 



SES PUPILS* 



REAOlS^ - 

GAINS . 

complexity 
low high 



M 



ARITHMETIC 
GAINS 

complexity 
le* Mgh 



..AFFECTIVE 
GAINS 

school self 



L2 



v ' SOURCE 
SYMBOL 



WGC 
OScAR 

CRAFT 
OScAR 

BE8 
(T4) 



BE Q87 



Teacher provides feedback 
to pupil on his/her behavior 



/ 

• * .1*5 
.ERIC 



III-VIII 



L' L* 



L 3 L 4 



0 L2 



L3 L* 



WGC FLA 



96 . 



IS**? ^ ^ : ~ %m 






> 
















. ; * ( > 


• * *»* 

j * ■ 

» *v 


' y' 

/ Table 32 


- MANAGEMENT SKILL I-I II 






i 






of. 

* , l J 
/ ' 




























LOW 


^SES . PUPILS 


HIGH 


SES 


PUPILS 






; ~, 


" _ ' BEHAVIOR- ITEfcU , 


GRADE 


READING 
GAINS 

complexity, 
1w Meh 


ARITHMETIC 
CAINS 

complexity 
low M<jh 


AFFECTIVE 
CAINS 

*<*ool self 


READING 

GAINS 

complexity 
low Mgh 


i 

ARITHMETIC 
GAINS . 

3 

complexity 
lev Moh 


AFFECTIVE 
GAINS . 


SOURCE ' 
SYMBOL 




w 


Control without^ criticism 


I 


Hi 






Hi 






WGC OScAR 


« . i 




Teacher maintains self-control 


'* I 


Hi 


< 


H2 H3 


Hi 




H2 H3 


WGC FLA 




* . 7 :/ - 


Teacher uses variety of control 
techniques, non-verbal ' 

* i 


II 


Hi h2 
n n 




L 3 


Hi H 2 






WGC .FLA 


-* 


- / ■ / 
} * r 


Proportion of management errors/ that 
are overreac£1ons • ~- » 


II-IH , • 


u 
n 






L 


H H 




BE, R161 


/ 


j * * 
> f 


♦ *\* ' * 
Teacher supports appropriate, Ignores 
Inappropriate, coping behavior ^ 

Proportion, of management errors that 
♦re errors In timing 


II 








0 


L2 ^ 


• ** 


WGC CS10 




,- J™" f ^ 


II-III 


L L 






L 






BE R160 




J 

1 . . 


/ 

■ J , 


.- 


• 












t 






















1 


AO 


^ ERjC 























*• " 


5 


a 








7 * 




> 


Table 33 - 


MANAGEMENT SKILL III-VIII 






* 








•* 






• 












LOW 

Lvn 


SES RUPILS ' 


tflGH 


SES 


PUPILS 




\ ! '.' ^ ■ BEHAVIOR ITEM 


GRADE 


RCAOING 

. «IW.' 

■» * V 


ARITHMETIC ' 
GAINS 


AFFECTIVE 
GAINS 


READING 
GAINS 


ARITHMETIC 
GAINS 


AFFECTIVE 
GAINS . 


SOURCE 

SYMBOL • . 


v ' ■' i ~ . 


complexity 
Iom ' hlgh- 


4 complexity 
W high 


school self 


complexity 
low high 


complexity 
Iom high 


school self 


/ 


Control without criticism 


III-VIII 


1 . r 1 

' H ; 


\ * 


H 2 H* 


H l 




H 2 H 3 


"WGC OScAR 


Teacher maintains self-control 


III-VIII 

* 


Hi h 2> 


H 4 




H 1 H 2 


H 3 H 4 


, H 5 


WGC FLA ' ^ 


Teacher supjferts appropriate, Ignoni 
Inappropriate, coping 'behavior 


es 

III-VIII 


Hi 




* 


H 1 






• WGC CS10 


x Teacher uses variety of control- 
techniques, verbal and non-verbal 


III-VIII 




L 2 L3 




L 1 


L 2 L 3 




WGC FLA 


Supportive classroom management 


III-VIII 




JL 2 _L 3 


} 

I 




L 2 L 3 

> 


> 


WGC FLA ' 




» 


* 






\ 






• ./ 
/ • . 4* 

*,.(»•***< 


ERIC 99 f~~^ ./ 


1 / * 


Jt 

/ 


* 

* 




/ 


i 


.,ioo - 




Teacher rebukes, desists with . 
Inappropriate pupil behavior. Y 

. " - y { V iv-i; - ... 
Negative motivation (language' , - ' , 
experience method with audi o*v1 sua! M " 
enrichment) '. '*:" \7 '■■ , 

. \ . t- - ;•"/-.•■;; £, ' •' • 

Negative motivation (ph&no-visual 
method) . , ? ;v 



Negative motivation (except language 
experience method with audio-visual 
enrlclwent) 1 - 



II 



II 



LOW SES PUPILS 
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>\ 



ARITHNCTIC 
CAINS 

low 'Mfh 



. AFFECTIVE 
CAINS 

ftcfcool Sfflf 



HIGH 



WADING 
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complexity 
Tow hffh 



4 1 



SES 


'PUPILS 


AAITHHCTIC 


AFFECTIVE 


CAINS 


GAINS 








scdool stlf 
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SYMBOL 



WGC OScAR 

WGC CS5 . ? 

CRAFT * 
-OScAR- - 



CRAFT 
OScAR 



CRAFT 
OScAR 



III-VIII 

o 



FRir 



Teacher hostility 

Teacher rebukes, desists with' * * 

Inappropriate .pupil behavior III-VIII 

Teacher criticisms, rebukes, desists III-VIII 

Domlnative teaching style with control 

through shame, ridicule, and threat/ IV,VI 

Teacher warns pupil \ IV 



H i h 2: 

V 



L 2 L 3 
L3 

L 2 L 3 



VS H2 



X 



0 

L 



L 2 t 3 

l2 L 3<: 



L L 



WGC OScAR 

WGC CS5 . - 
WGC OScATT^ 

GG 



Table 35 - DISRUPTIVE PUPIL BEHAVIOR . ( j ^ \ - v. 



BEHAVIOR^, 



\ 



0 - * 4 




. LOW 


SES PUPILS 


- HIGH 


SES 


„ PUPILS 




* A 

* ; ^ BEHAVIOR ITEM 


GRADE 


KAOMG 


ARITHMETIC 

GAINS 
complexity 
to *Mth 


AFFECTIVE 
tctool * self 


- CAINS 

coapltxlty 
low Mth 


\ - ' 
AJITHHtTIC 

CAINS 
\m Mfh 


AFFECTIVE 
CAInT^* 

sdwol $tlf 


\ yfamC \ /a 

• v ' 4r 


..-^Teacher talks over pupil noise 


I 


H / 






* * 


} ' 




Bem1s\Tl . - I 


^ pupil behavior 


I 


H 










Bemls P2 A" 


Disruptive pupil behavior 


I 


L 












D M 4. 01 / 

DOTUS rl f 


Pupil negative affect 


I-H 


0 


L 1 




i 

I 


il / i2 

*' 




S73 FLA7 . < / * 


ncy«v^¥c |aij/i 1 ocnav lur ^ 

Inappropriate pupil talk 
Reduced deviant behavior 


TT 
11 

II f 
II 


o 

I* 


L' L c 
0 


H 2 


ii 


H 2 >> 


• . • A -. - 
BTES AP (\- J 

MGC FLA / 


Freq. discipline problems attrt- 
•- buted to lack of Interest (self report) 


II-III 




L 






. \ 

L 


* 


BE 0^' 


Reduced deviant behavior 


III-VIII 


H 1 H 2 




n rl 


Hi H 2 






Wgc / la - ' / .) ■ 

BTES AP.. I 

' / \ • % 


; Inappropriate pupil talk' 


y V 
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* * 
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Table 36 - PUPIL INVOLVEMENT 



..VP** 



BEHAVIOR ITEM 



GRADE 



Pupil not responding to adult 

Absence of withdrawn behavior 

Pupil calls out answer to 
teacher question 



Pupil on task, actively Involved 
Pupils on task, Involved 

Absence of withdrawn behavior 

Pupil joins In class or group 
activity 

Pupil attentive to .subject 
of lesson 



IIMUII 

in-vni 



LOW SES PUPILS 



Hi 



MITHHOIC 
cwpltxlty 



scfcool self 



H K 
L 1 



H* 



HIGH 


SES 


PUPILS N 


* - WADING 


ARITHMETIC 


AFFECTIVE 


ttlNS 


GAINS' 


CAINS 




cwflufty 




low M9H 


\m Mfh 


scNool stlf 



H* 



Hi 



H2 



K S0URC€ 
SYMBOL 



BE A4 



WGC FLA 

HSC TP3,«5 
10 



Table 37 - PUPILS SPEAK FREELY 



BEHAVIOR ITEW 



GRADE 



Pupils ptril$tea~to s|eak freely 
Pupils i{ 



Teacher .^outages pupil s 
to speatflp&y 



ll_ 
11 



II 



-^^JOcie1'"1nteract1on among pupils 
Verbal Interaction among pupils 



If! 



Teacher listens while pupils Interact III-VIir 

— iri^vni 



Teacher encourages pupils 

~to~speak-f reely — — - ~ 



Pupils speak freely 



IX t XII 



LOW SES PUPILS 



NEA0WG ' 

cains 

CMpltxIty 



ARITHMETIC, 
CAINS . 

COflpltxIty 
low M#k 



AFFECTIVE 
CAINS 

tdwol self 



H 1 

H 

L L 



*HH3f ; *SES PUPILS' 



HEADING 
CAINS 

complexity 
\* Mfh 



t£ L 3 



AAITMHETIC 
CAINS 

coojltxity 
If* Mflh 



1 



.Hi 



AFFECTIVE 
GAINS 

sctool stlf 



H2 L3 



SO'JRCE 
SYMBOL 



UGC FLA 
WGC OScAR 

WGC TP7, 
15 

*SK 234 
SK 476c 



HSC OSCAR 



MGC TP7, ' 
15 

WGC OScAR 



t 

It 



I" 



\ 



table 38 - POSITIVE AFFECT < 



. BEHAVIOR ITEM' 



GRADE ' 



Teacher positive i«f feet (enthuslastlc'i 
-friendly* etc.) 

Pupils happy, positive attitude 
and climate 



Percent of management requests 
followed by thanks 



,pSpil pride, cooperation vs. apathy, 
"fear, etc.. . 

- ♦* < . j. j- . 

- *. Pupils enjoy class m - 

• r \ ' Teacher develops "we." feeling 



II 

II- II I 
II 

« II 



II \" 



Teacher develops "we" feeling 
Pupils ertfoy class 



III-VIH 

TXrXII 



CM 1 ; 



1.0-9 : , 



LOW SES ' , PUPILS 



KMUNG - 

*' sains" 

<w?ltxity 



/ * 

Hi # 

^ H 2 



ARITHMETIC 
CAINS. ' 
coapltxtty 
low jjjjh 



AFFECTIVE 
CAIKS 

school self 



h* H 2 



Hi " H 2 



to* , 
k 



H 2v . V 



Ih^h 3 ' 



1 ^ 35 
HIGH ' SES 1PUPILS 



READING 

GAINS 

complexity 
low Mgh 



11 



ARITHMETIC 
coapltxlty 



AFFECTIVE 
• GAINS- 

school stlf 



L 

" * Ll 



SOURCE " 
S>MB0L c 



H< 

H 2 H 3 



S73 FLA9 

*S73 CDR2 „ 

BE PI 54 

' WGC OScAR 
WGC FLACCS 
WGC FLACCS 



WGC FLACCS 
WGC FLACCS 



-A id " 

ERjC 



) 
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Table 39 - REINFORCEMENT 




BEHAVIOR ITEM 



GRADE 



■A 



Wf thT token— task-related, non- 
academic achiever 

With token-all 



\ 



"Sailles 11 , gold stars, etc. * 
(self report) 

Special privileges (self report) 



I 
I 

IMII % 
IMII 



LOU SES PUPILS 



HEADING 
WIRS - 

low Mth 



H H 

L L 
L L 



AWTHKTIC 
CAINS 

cwpltxlty 
low Mjh 



AFFECTIVE 
CAINS 

tdiool self 



H K 



HIGH " ' SES PUPILS 



NEAOING 

~ GAINS 

complexity 
low' ^i«H 



L 
H 



1, 



ARITHMETIC 

GAINS 

molarity, 
lew high 



AFFECTIVE 
GAINS 

scfcool self 



.V 



SOORc/ 

V 

SYMBOL 



SK 401a, 
SK 469a 

BE Q46 
BE Q47 



ERIC 



tr.ll 
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Table 40 - PRAISE 



LOW SES_PUPILS 



READING 
GAINS 

complexity 
U* Mgh 



H' H 

'" H 
H " H 



L L 



ARITHMETIC 
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complexity 
lot Moh 



H * H 



AFFECTIVE 
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school «lf 



M 



HIGH J^ES^^PUPlfc* 



READING 
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complexity 
low 



H M 



I L 



M M 



ARITHMETIC 

GAINS 

co^lexlty 
low Mgh 



M 



L \L 



AFFEcm^ 

GAINS • V 
school self 



^SOURCE, 
SYMBOL 



Iff 



SK 398a 



CRAFT 
OScAR 



craft' 

OScAR 

C*AFT ; 
GScAR 



BE Q39 
BE PI 33 
BE Q155 



f 



Q155 
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BEHAVIOR ITEM 

_ \ 



GRADE 



Non-academic direct questions, 
requests, commands to Individual 
pupils 

Teacher non-substantive talk, 
pupils Interested 

Pupil responses, non-academic , 



III 

II. 
Ill 



V 



LOW SES PUPILS 



nrnrn 
cams 



L 1 L2 



MITWCTIC 

CAINS 
«m*l«lty 



affective 
1 self 



HIGH SES 



(Aim — 

c^pltxlty 

Ion . 



t 1.~ » 



ARITltfCtlC 
c«*ltm1ty 



J5JPI1S 



rn 1.^.1 



. UUNS 



L l t 2 



SYMBOL^ 



'4 * ; y 

v -fefe. . ' 



WGC CS4j 
SK 359a 

/ 



tw: ;r*; a- 



;' V 
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Table 43 - PERMISSIVE TEACHER BEHAVIOR 



\ 
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SES? PUPILS ! 


HIGH 


SES 


»UPILS 


> \f. 






• MAO!* 


MUTHWCTJC 


AFFtCTIVt 


worn 


JtlTWCTIC 
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■ SOURCE 


BEHAVIOR ITEM 


GRADE 
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SAINS 
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Ji 


• 1 
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$73 TP5 * • 
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tT 




L 3 
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OScAR . 


Proportion of pupil requests 
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*» 
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H 






H 


H 




BE P142 


Pupils speak aloud without 
asking permission ^ 


ii 

i 




\ 




L 1 L2 






MBC FLA 


Proportion of pupil-Initiated work 
contacts delayed 


H-HI 


\ 




\ 
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BE P136 ' \ 


Permissive teacfier behavior 


~ III-VIII , 
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OScAR 


* \ 

Teacher control » structure vsl 
permissiveness, spontaneity 
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FUTURE DIRECTIONS FOR PROCESS-PRODUCT RESEARCH 

The results reported In this study are both encouraging and discouraging. 
It Is encouraging to find that the use of the process-product model has yielded 
so aany consistent Indicators of how effective teachers behave; clearly this 
kind of research can Increase, and ha* Increased," the knowledge base for 
teacher educa tion. But It Is discouraging to note how small the contribution, 
how slow the Increase has been. Are there any steps that can be. taken to 
Increase the productivity of research based on this model without abandoning 



' Under the assumption that the goal of research In teacher effectiveness 
Is to strengthen the knowledge base for teacher^ucat1on r -thepe-^are-at4eas1 
^ ! tep ?, that . sh °ul d be taken. One Involves a change In vrioriUei^in the 
way In which process variables are chosen for study; the other Involves a 
change In •**rt^--a modification In the model Itself. And the Implementation 
of these two steps Implies closer collaboration between the teafcher educator 
and the researcher than we have seen In the past* The knowledge and resources 
that each possesses must be brought together In a unified effort. 

^.ttew Priorities for Research In Teacher Effectiveness 



One consequence of the lack of such collaboration In the past cjn~be 
seen. by comparing a list of the teacher behavior. (process) variables studied ' 
by the rese -chers wUh-the list of competencies that define. the objectives 
of a competenw-basjgaiteachejL^^ program. By and large, the researchers 
do, not seejn^be studying the teacher behaviors that 0 the educators regard as 
Importantr There Is overlap, but the lists are far from congruent. 

This has two Implications, both of them' bad. First, we lose the Important 
contribution the teacher educator could make to selecting for study those 
teacher behaviors' likely to characterize effective teachers. And second, the 
results the researcher gets would have much more direct Implications for 
.teacher educajtton if they involved the competencies teacher education programs ^ 
>eekto develtip directly. Their relevance would be obvious; and negative 
findings* (which, alas, are far more common than positive ones) would be almost 
as useful as positive findings. 

Some.dali/rom one study reviewed Jn this paper (WGC) were recently" 
scored to yleloMieasures of a typical set of competencies, and correlations 
between the competencies and a number of measures of pupil learning were '- 1 
estimated {Lorentz,- 1977). More than 70% of the significant correlations. found, 
were negative, Indicating that the more "competent- a teachef was, the less hlK 
or her pupils Teamed from that teacher .» • A . 

• . * - . '• f - • V '•'«♦• 

Findings from this study have not yet been verified; if they should be, 
we would be forced to conclude that as teacher educators we are not merely 
Ignorant but misinformed about what makes an effective teacher. Perhaps the 
most disturbing aspect of the present state of affairs is that at present we 
do not know which we are. < " 

- ■ ' " c ', " . • - 

If there Is any danger that similar results Wbtild be obtained 'in other 
sites, then the need for more of this kind of research Is indeed urgent/ The 

^ J- * ~ 

. - . . .' ' ifl ... . ■ >: 



Implication that most of what we train teachers to do may tend to decrease 
their effectiveness. Is certainly alarming. .Bat even If these findings are 
disregarded, the fact.that we do not really know whether what we teach pre- 
servlce teachers makes them more effectlye Is Intolerable. 

„ The way out of this situation Is for future process-pr -duct research 
to use as process variables the same competencies that the teacher education 
programs are trying- to help teachers acquire; Researchers and teacher educators 
should get together to Investigate the validity of the letter's program goals. 

If the Information thus developed were used as the basis for program 
revision, and If the researcher continued to study the revised objectives' Jn 
the same way, the result would amount to a Targe-scale, continuous experiment 
In teacher educat1ohf^5dch an e*per1*ent-or better yei, a numftrorthel" 
linked. to several te*cher>educat1on programs— would have at least two. Important 
•ffects. First, It-would directly Improve the effectiveness of the program 
studied. And second, It would-'add as much to our understanding of the dynamics 
of effective teaching— or more— than any amount of the one-shot*, process-product 
research- that fs the present norm. This shift in priorities would make It 
possible for the research to be based on routine assessments of teacher com- 
petence at various levels of development-assessments that a^, or ought to 
be, an Integral part of any CBTE program. ~ 

» v i ■ 

V ** • 

* - , . ■ ■ ' 

Levels of Assessment In Teacher Education 

: P — " 7* " ^ ■ . . ;> n ' s 

Figure 1 shews four. points or levels at each of which teacher effectiveness^ 
has been or may be assessed. The horizontal arrows joining the boxes represent 
lines of Influence; Thus, the training experienoee provided in a teacher 
education program are Intended to change the performance competencies of a 
teacher In ways that will result In changes In the learning experiences pupils 
have, which will in turn change the pupil outcome '(hopefully, for the better). 

There" are, of course, many bther Important factors which affect pupil 
outcomes (such as pupil and community characteristics) that are not under the 
teacher's Influence or control. Because the present focus Is on the effect, 
of teacher education on teacher competence, and for the^sake of simplicity, 
these factors are»not shown In the diagram. 

In most states, teacher effectiveness Is assessed for certification 
purposes„at the level of training, experiences. In order to be s certified, a 
teacher must have completed an "approved program." The<bas1c Innovation " 
proposed 1n competency-based teacher education Is to base this decision on 
, assessment at the next level— to certify, teachers on the basis of demonstrated 
pMormance competencies. However, the essential Idea behind the pressure for 
^teacher accountability" Is that teachers* should be assessed at the level of . 
pupil outcomes. The trouble with this Idea 1s that It Is based on a fallacious 
assumption. It assumes that the lines of Influence shown In Figure 1 can be 
,read backwards as lines of responsibility.. If the 5 many other factors that 
Influence pupil outcomes were shown In thfe d1agram,-th,e fallacy would be 
obvious. ^ . f - ' r 

• ■ .-~r— *- . " . - - 

T Wdly enough, nobody seems. to have advpeated the assessment of teacher 
competency on the basis of learning^experiences the teacher provides ,for 
pupUs. The use that the teacher makes of pupils* time seems a.more defensible 
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Program Evaluation Loop; .. 
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FIGURE 1. LEVELS OF. ASSESSMENT OF TEACHER COMPETENCE 
\ .. - IN TEACHER EDUCATION . , f j 



This, figure is adapted from p. r 12 in Donald. H. Medley /Roberts. Soar, and. Ruth Soar, 
Assessment and. Research, In Teacher Education: Focus on PBTE. for ithe AACTE Committee 
on Performance-Based Teacher Education (Washington, D.C.: American Association of 
Colleges for Teacher Education, June. 1975); > ft » . 



t v 



121 



focus of accountability than the outcomes obtained— If for no other reason than* 
that the. teacher has much more control over 1t. — 



/ ' ,^:4n program evaluation (see Figure j), teacher educators examine the rela- 
t1oP v sh1ps between the training experiences teachers have and the per jomance 
oomgetenwie* they exhibit 1n the classroom. Teethe extent that the training 
experiences produce the competencies defined as objective* of the training 
program, the program 1s evaluated as effective. * - ^ ; V 

•"V - • •, -. \ 1 - . **• 

v In order to evaluate, or validate, program, objectives, teacher educators' . 
examine the relationships between the performance oompetenoiee a teacher 
exhibits and the (mean) pupil outcome In his or her class. If those teachers 
displaying a particular competency produce greater pupil gains . than those not * 
displaying It, that competency Is regarded as a valid objective. 'It should be 
noted that.lf our suggestion about research** priorities were .Implemented, program 
validation and conventional process-product TesearcH would become two names for 
the sane activity. / 

• \ . ■ • * ' ■ . ■ . v. ■ . .y. ^.. :< 

Future Strategy for Process-Product Research * 

Figured also reminds us that 1t 1s the learning experiences each pupil 
thas Hhlch-Hetermine pupil outcomes. Thus, to the extent^ that different pupils < 
.1n the same classroom have different learning experiences, the learning outcomes 
also differ from pupil to pupil. y - 1 

It seems Important, then, to study the relationships between the learning 
experiences a pupil has (pupil behavior while under the? care of a teacher) and 
pupil outcomes (what the pupil learns). These relationships have, of course, 
been the object of considerable-study in the past, called research ip. etaeeroom 
teaming. . * 

~ It" sterns equally Important to study the relationships between teachers' \ 
performance competencies (teachers' behavior while teaching) and their pupils,' 
learning ^perlences (pupils' behavior while under the teachers' care). Such 
research could well „ be called research in teacher competence. 



It Is perhaps time to consider whether the process-product model as we 
know It may not have outlived its usefulness, If for no other reason than that 
it Ignores two critical variables almost completely: the Intent of the teacher, 
and the behavior of the, individual pupH. 



« 

As the model 1s Implemented, the process variable— the classroom behavior 
measurement— is obtained without regard to the purpose or intent of the teacher. 
The amount of praise used by a teacher (for instance) 1s typically assessed by 
observing the teacher on a number of occasions chosen to approximate a random 
sample of the teacher's behavior during* the year, ^attempt is, made to 
ascertain w{ien or for what purposes a teacher uses; praise or avoids 1t. 

. It seems obvious to anyone who has taught, or^studied the behavior of 
teachers i .that when or for what purposes teachers' use praise is- at least as 
important as how much, 1n distinguishing effective from Ineffective teachers; 
Just as when and for what purposes physicians administer cortisone is at least 
as Important to their success as how often they administer' It. .* 
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: In the .conventional application of^hje_pxocess-product model, It 1s also 
the practice 'to relate teacher behavior to the mean gain of the pupils In a " 
class. It seems obvious that, even when allowances are made for preexisting . 

pupfl differences, different pupils 1n the same classroom learn different^ „ 

amounts. Use of the class mean, as- a- product ifleastire- ignoresrthese-dtfferences . 



. It is one of the truisms of education that learning results from the 
.activity of the learner— a truism that receives- considerable Hp service but 
Is usually disregarded 1n practice. The process-product model in effect -j. 
• .assumes that 4 earning results from the activity of the teacher. Granted that 
. .the very premise of teacher education 1s that teacher behavior affects learning. 
But tt)1s effect is Indirect. Teacher behavior can affect learning only through 
■< its effects on'leaVner behavior: The teacher teaches, but the pupil learns. , 

Somehow, In future research in teacher effectiveness, we must find and 
use a model in which the teacher's Intent or purpose and the behavior of the ' 
^s4ndiV1dua1 pupil both play a part* . ' .. . y . — "| 

' J' Perhaps the answer will Involve the description or assessment Of teacher 
purpjose^imeanlng the* learning experiences teachers Intend their pupils to have; 
and instead of correlating .teacher behaviors. with outcomes, we will correlate 
. teacher behaviors with pupil behaviors. The ,l tompetent teacher would be the 
teacher who can behave 1n such a way that pupils have the learning experiences 
the teacher intends them to have— prescribes for them, if you will. 



There 1s a secohd ? ~component 1n .teacher competence, of course: the pre- * 
scribed learning experiences must be those that maximize pupil learning outcomes: 
the; competent teacher must, then, be able to diagnose pupil needs— to recognize 
what each pupil needs to do in order to learn. 



Teacher competence thus involves a knowledge component-- knowledge of 
relationships between pupil behaviors and learning outcomes; and a performance 
.component— the ability to act, to behave, in ways that will help pupils exhibit 
these behaviors,, have these learning experiences* 

«j .* * - ; . '; 

* Research 1n teacher effectiveness might split, then, Into two phases; the 
study of teacher behavior in relation to pupil behavior, and ,the_s_tudy of pupil 
behavior 1n relation to pupil learning Outcomes. ' 

It would seem much more productive 1f the principal focus of futurfe • 

research were on correlations between teacher behaviors and piipil behaviors, 
thatjs, between competencies and learning experiences, rather, than on corre- 
lations between teacher behaviors and outcomes. The former correlations should 
be mtich easier to detect. * . . ! . 

\ At .the same time, the secondary focus should be on correlations between 
pupil behaviors and pupil outcomes. Our understanding of the dynamics of 
effective teaching should Increase much more rapidly 1f this strategy were 
to be" adopted. And there 1s no reason why data collected for these purposes 
cannot also be analyzed to yield process-product correlations— the correlations* 
between teacher competencies and pupil learning outcomes that are, and must 
remaj|i,:the primary basis for program, validation. 5 

In~ this way, the close collaboration between the researcher and the 
teacher educator We have advocated above can produce maximum Improvement 1n 
the effectiveness of teacher education programs while (Instead of after) 
l - ^eveWpirig the solid research base that seems so far out of reach today. 

IC* 70 - 



:*■,<.« 



REFERENCES * ' 



Brophy, Jere E. and Evertson, Carolyn. M. Learning Fran Teaching: A 
Developmental Perspectl ve. Boston: Auyn & Bacon, 1976. 

Dunkln, H.J, and Blddle, B.J.' The Study W Teaching New York: Holt; > 
.■' -Rlnehart and Winston, 1974. 

Lorentz, Jeffrey L. "The Development of Measures of Teacher Effectiveness 
' frjow Multiple Measures^of Student Growth. " Paper presented_at the 

Meeting of the American Educational Research Association, New York, 

April 7, 1977; ,, :.. * 

■'■ ' ' ■ ' •* k* 

Rosenshlne, Barak. "Classroom Instruction." Chapter X. The Psychology 

of Teaching Methods . Seventy-Fifth Yearbook of the National- Society, 

for the Study Of Education. Chicago: NSSE, 1976, pp. 335-71. { 

Teachl ng Behaviors. andrStudent Achl evement . Windsor, Berkshire, 



* Teaching Behaviors- andrStudent Achievement. Windsor, Berkshire 
7 England: National Foundation for Educational Research 1n England and 
Wales, 1971. ; : ? • f ; 

- v. ? -" ■« .. ... « % - • v . . - -. ■ 

v . and Furst, Norma. "Research on Teacher Performance Criteria." 
~ IrTB.O. Smith, ed. Research in Teacher Education: A Symposium . 
. Englewood Cl,1ffs, N.X1 Prentice Han, is/v, pp. 37-7Z. 7" 

. and Furst, Norma. "The Use of, Direct Observation to Study Teaching, 
in R.M.W. Travers, ed. Second Handbook of Research on Teaching. Chicago: 
Rand-McNaljly, 1973, pp. 122-53. ~ — B • ! 



t -. 



31^ 



APPENDICES 




72 

' 128. 



•1. 



W>'S • 



SYMBOL 



APPENDIX A 
DETAILS ON STUDIES USED 



STUDY 



Brqphyr'Oere E. and Evertson, Carolyn N. &poo*99-t*oduot 
Corvelatidna in the T«xa» Teaoher EffeoHvauus Study: 
Final Report. Austin: - University of Texas at Austin, 
June 1974/ , - • 



PROCESS MEASURES 



X 



Brophy-Good Dyadts Observation System 
OUTCOME MEASURES , ' . j 
Reading 




High Metropolitan Achievement Test 
Word Knowledge ' , . > 
Reading ^ 
< > 4ow Metropolitan Achievement Test 
? Word Discrimination 
Spelling 

Arithmetic High Metropolitan Achievement Test 

Arithmetic Reasoning 
Low Metropolitan Achievement Test 
, v Arithmetic Computation . 



Grade Level 11*111 

28 classrooms of High and Low SES 



y 



> ■ 



73 12,& 



SVMMt - 



* . - X- 



•v.-.,.-- »inwu — ' STUDY 

iV f*;-'- ; ' >-v'- ■ % ■ ■ • .. 

B«i$„_i. B«1$, Katherlne and Luft, .Max. "Relationships Between 



Teacher -Behavior, Pupil Behavior, and PupH Achievement." In 
Anita Simon and E. 6. Boyer, eds.~ Mirrors for Behavior: An 
Anthology of Observation Instruments continued n WSuppTe- 
ment, vol. A. pniiadeipnla: Research for Better Schools, 
1970. v • • 



PROCESS MEASURES 



Southwestern Cooperative Educational Laboratory 
Interact1on*0bservat1on Schedule (SCIDS) 



OUTCOME MEASURES 



SAMPLE 

. 4 0 



V 



Reading 

i 



Low Lee-Clark Reading Readiness Test 
-Concepts 
Letter Symbols 
Word Symbols 
Total ' 



Grade Level I v 
15 classrooms of Low SES 



S 



\ 



• ERJC V 



74 

130 



tBTES 



4 




STUDY 



'McDonald, Frederick* and Ellas,* "Patricia. The Effteu r of 
V Teaching Pcrfomato* on Pupil Learning. Beginning Teacher 



Evaluation Study: Phase II, 1973-74. Final Report: Vol. 
,1. Princeton, H«3.: Education*! Testlng'Service, 1976. 

f^lWESSMEASURESf>; ' ' ' 

'"■'T.. . Anecdotal Process for Promoting the Learning Experience (APPLE) 

- « Reading and Mathematics Observation System (RAMOS) 
' . , « Work Diary (WD) 



\ 



^^i>^^OlfTC0ME MEASURES 



SAMPLE 




3=T 



Reading H1ghf California Achievement Test, 

Reading Comprehension, Level 2, 

2— F-orm A- ,'*•_'.? - ,; »" ■ 

Reading Application ; 
Reading Achievement / 
Low Decoding*, .* - / • * 

Pictures— Sound Correspondence 
Rhymes 

• Word Recognition - 

< , ' Sight Words < 
Root Words 

. X ^ ♦ Words from Root Words - 

word Sounds. 
Ari thmetic High California Achievement Jest, 

Mathematics Concepts, Level 2i 
"7 " * " Form A 

" Mathematics Application* 
Low California Achievement Test, < 

Mathematics Confutation, Level 2, 
Form A . 

Attitude School •• Attitude Toward Kathematlcs 



Grade Levelll r 

41 classrooms of High and Low SES. 

' . ' - * ,) 



■■ 5' ' ',r 
4.- 



"*S," 



♦Specially developed for the study by ETS. 



■ ERIC • 



ft. 




SAMPLE 



Reading High California Achlevonent^TestirReadlng-- 

Comprehension, Level 3, Form B 
r A Reading Application 

Reading Achievement 
**. Low Decoding* - 
f Word Sounds 1 

; First Syllable , 
Last Syllable 
Root Words 
. ~ Words from Root Words \ 
- « Word Sounds ' \ ■ 

Arithmetic High California Achievement Test, 

MatraMtlcs Computation, Level 3, \ 
Form 8 
Mathematics^ Appl Icatlon 



Low 



California Achievement Test, 
Mil" 



kinematics Concepts, Level 3, 
FormB 

Attitude School Attitude Toward Reading 

Attitude Toward Mathematics - 



... A' 



Grade Level V 

54 classrooms of High and Low SES 



• \ 

t 



\ 



X v. 



♦Specially developed for the study by,ETS. 



SYMBOL STUDY 

CWFT ' Harris, Albert J. and Server, Blanche L. Comparison of Ridding 

. Approach— in Fint-Grcie Teaching vith Headwrntaged Children. 

(The CRAFT Frojeot). (Cooperative Research Project No. 2677), 
few York: Division of Teacher Education, The City University 



of New York,- 1966; - r* 



PROCESS MEASURES 
/ — . ' * 

The tially Log Form, (Log) 

Observational Scale and Rating-Reading (OScAR R) 

OUTCOME MEASURES < ^ \\ 

Reading' High Stanford Primary I Battery Form X \ 

Word Knowledge 
f Paragraph Meaning - 

Vocabulary 
. Word Study Skills 



SAMPLE 



Grade Level I 

48 classrooms of Low SES 



SYMBOL ° STUDY , 

'* •/ ' . - - . 

CRAFT Harris, Albert J.; Morrison, Coleman; Serwer, Blanche and Gold, 

Lawrence* A Continuation of the CRAFT Projeot~ Comparing 
Approaches vith Disadvantaged Fegro Children in Primary Grade: 
New York: Division of Teacher Education, The City University 
' of New York, January 1968. - >- 



PROCESS MEASURES 



The Dally Log Form (Log) 

Observational Schedule and Rating-Reading (OScAR R)^ 



OUTCOME MEASURES 



Reading \H1gh Metropolitan Advanced Primary, 

Form C 

Word Knowledge \ 
Reading . . \ • * 

Low Metropolitan Primary II, Battery 
c Word Discrimination 
I Spelling - «. • 



SAMPLE 



Grade Level II 

38^ classrooms^ of Low SES 



SYMBOL 

G6 



STUDY 

V - 

Good, Thomas L. and Grouws Douglas A, Proo*s$-Produot Rela- 
tionship in Fourth Grade Mathematics Claeevoome. Columbia: 
University of Missouri? October 1975. (Final Report to the 
National Institute of Education). * . . 



PROCESS MEASURES ~ . j 

^4 Brophy-Good Dyadic 'Interaction System 

OUTCOME MEASURES < r ' " 

. Arithmetic High Iowa Tests of Basic Skills 

* Mathematics Concepts . 
' Mathematics Problem-Solving 
j. Both Iowa Tests of Basic -Skills 

P Total Mathematics 



SAMPLE 



SYMBOL 
Perhsw 



Grade Level IV 

41 classrooms of Klgh.SES 



STUDY* 



Perham, Bernadette H. "A Study of Multiple Relationships Among 
Teacher Characteristics, teaching Behaviors and Criterion- 
Referenced Student Performance 1n Mathematics." Unpublished 
doctoral dissertation, Northwestern University, 1973. 



PROCESS MEASURES 

Sign System Observation .Schedule " 
OUTCOME MEASURES « 



j 



•A 



SAMPLE 



Arithmetic Low DMP Topic Inventories,. Level V, 

Forms 1 and 2* ;>.•*•' , 



Grade Level K-I 

11 classrooms of High and Low SES 

r \ * * 



'Specially, developed for the study. 



SYMBOL 

as. 



■ ■'. ffrr. r . 

» {, . J*. 

Soar, Robert S. An Integrative Approach to Classroom Learning. 
Philadelphia, Pa-.? Temple University, 1966. Ti . ' SL 



V # I V > 



PROCESS MEASURES 



South Carolina Observation Rating, (SCOR) 
Flanders • !A (Interaction Analysis) 



OUTCOME MEASURES 

Reading 




High Iowa Test of Basic Skills 
Vocabulary 
. Reading 

itlc High Iowa Test of Basic Skills 



; SAMPLE 



Arithmetic Problems . r. 
Both Iowa T*st of .Basic Skil ls . 

Arithmetic Total 
Low Iowa Test of Basic Skills ■< *■ 
Arithmetic Concepts v - 
Attitude School My Class Inventory > 



Grade Level III-VI 
57 classrooms of' High SES 




79 



SYMBOL 



STUDY 



: "V 



o 



Soar, Robert S. and Soar, Ruth M. *An Emplrlcaf Analysis of 
Selected Follow Through Programs: An Example of e Process 
Approach to Evaluation." In Ira J. 6ordon.-ed. Early Ch11dr£ ,-, 
hood Education. Part II. The Seventy-First Yearbook of the^ 
National Society for the Study of Education. Chicago: HSSE, ISO*. • 



PROCESS MEASURES "' 



Up. 



^Florida Affective Categories System (FLAC) \ 
r teacher Practices Observation Record (TPOR) i £1 
Rorlda Taxonomy of Cognitive Behavior (TCB) 



Reciprocal Category System (RCS) 



^oVrCOHE MEASURES 



■ i. 



SAMPLE 



r-vr 



Reading* 




Arithmetic* 



Metropolitan Readiness Test 
Word Meaning 
Matching i^sZ*J 
& Llsj " 
pying 

Metropolitan Readiness Test 

Alphabet <• ' 
Early Childhood Inventory (Deutsch) 
, Alphabet . *<*■ 
Metropolitan Readiness Test - 

Numbers Vsn* 
Early Chi 1 dhood Inventory (Deutsch^ 

, "Early Childhood Inventory »22"*««h) 



Shape Names 



v\ 



Grade Level K-L,, 

70 classrooms of Low SES. 



-t 




7 ' 



!>'•' *H1gh and low complexity outcomes were measured on factor scores across all 

: . * tests of both subjects. - ■ 



1 ■ 



,4'ERJC 



■A. f 



SYNKjL 

o 

$73 : 



Soar, Robert S. *MZ<*> ^trowe* CUmwoam 9*oo$n 
<wlftip« (1970-Wl). Final Reports Gainesville: 

Collage of Education,* Untverslty of Florida; 1973. 



PROCESS MEASURES 



k ... \ 

if' . . 



Florida Climate and ControliSystem (FLACCSV 

Teacher Practices -Observation Record *<TP0R) 

Reciprocal Category System (RCST j 

Florida Taxonomy of Cognitive Behavior (TCB) 

Global Ratings and Classroom Description Factors (COR) 



OUTCOME MEASURES \ \. 

Reading* 





1 . ' 




• • . l\ . » ■ 








SAMPLE ' 











Lee-Clark Reading Readiness, Test 
v Matching. Letters and Words 
Wide Range Achteveoent Test 
^ Spelling' from>0fctat1on: 
AWord Reading -AJoud 
Meti»opeTi tan /Readiness Test? 
.Malxhfhg" t^T/*' 
■ " Copying 

Experimental SponW Items** 
Order of Alphabet.,- '. V 
Wide Range Achievement Test 
• ; Naming Letters 

Recognizing 2^Letters , . 
-. Metropolitan Readiness Mest 
.. -AlpKbet J; -v.44\ ' .. 
■ - . • Early Childhood Inventory / 
v ♦ Alphabet 

Arithmetic* Wide Range Achievement Test 

Solving; Problems , 
Written Computation 
*. Metropolitan Readiness Test 
% Numbers . • v 

• - Wide Range Achievement Test 
- Counting .15 Dots 0 
Experimental Sponsor Items** , 
~ -' ■:. Count Numbers^. ■. ". 

Write Numbers: ? i 
Attitude * School Days Absent * 



Grade Level K-I . 

130 classrooms of Low SES 



hi 



,*H1gh tad low -complexity Outcomes were measured on factor scores across all 
; tests of both subjects. - h ' 

^•SpedeTly developed for the stuty. 



if . I 



•• 81' 137. 



"TO 




^OUTCOME MEASURES • 



' .,< v • - 



Reading' 



SAMPLE 



12'. 



Arithmetic* 



"S2K 

Numbers 

Attitude School Days Absent 



Grade Level II 

20 classrooms of Low SES 



Metropolitan Readiness Test 
- Word Meaning • \* • 

Matching \ 
Experimental Sponsor Items** 

Opposltes \;.) 

Verbal Opposltes 

Similarities !"7 

Absurdities 

Word and Phrase Reading 
. Reading Sounds- 
.Story Reading - 
. Comprehension \ 
Stanford Achievement Test 
'Word Reading 1-10 
Word Reading 10-20 t**. 
Wide Range Achievement 1 Test ; 
Spelling ' • * "» * * »' \ 
Word Reading Aloud 
Wide Range Achievement Test 
1 Naming 13 letters V 
Experimental Sponsor Items** 

Days of Week > 
Metropol 1 tan Achl evement Test 

Arithmetic' Computation 
Experimental Sponsor Items**! 

Reading Numerals ' 1 

Wide Range Achievement Test \\ 
Which Is More 
Written Computation 
Metropolitan Readiness test i 



-1 




\ 



V 1 



♦High, and low complexity outcomes were measured on factor scores across all 
tests of both subjects. *„• ! 

.' ^Specially developed for the study. \ , ' • • 



¥38' 



STUDY 



•A 



Soar, Robert S. and Soar, Ruth M. Claavcoom* Behmibv, Pupil 
CharaoteriaHoa and Pupil (booth for the School Tear and the 
- Smmv. Gainesville: College of Education, University of 
i+fr: Florida, December 1973. - 



A 



;.W)CESS-«EttURES N 



ft*; ' 



i Florida Climate and Control System (FLACCS) 
Teacher Practice Observation Record (TPOR) 
Reciprocal. Category System (RCS) 
Florida Taxonomy of Cognitive Behavior (Cog. Tax.) 
Globa] Ratings (GR) «• \J> 



OUTCOME MEASURES 

\ % « ; / y 

Reading High Iowa Tests of Basic Ikll Is 

Reading - 
Vocabulary 
Low Iowa Tests of Basic Skills 
Spelling , 

Arithmetic Both Iowa, Tests of Basic Skills 

Arithmetic Concepts 
Attitude School Days Absent 
Self-Concept Self :How I See Myself 



SAMPLE 



v 



Grade Level V r 

81 Classrooms of "High and Low SES 



; - »i 



139 

83 * 



A. 



SYMBOL 

SIC 



STUDY 



StalUngs, Oane and Kaskowltz, D. Folloa -Through Claeehxm 
Obeervatxon Evaluation 1972-1973. A Study of Unplmwntat- — 
Menlo Park, Calif*: Stanford Research Institute, 1M * 



tinpt0nent(itioif7 
te, 1974.1 v. 



PROCESS MEASURES 



Classroom Information Instrument (COI) 
«r-Classroom Summary Information (CSI) 
—Physical Environment Information (PEI) 
—Classroom Observation Procedure (COP) 
-Classroom Checklist (CCL) 
— F1ve-M1nute Observation Preamble iPRE) 
— F1 ve-M1 nute Observation (FMO) 



OUTCOME MEASURES 

Reading 



A • 

SAMPLE 



A . 



Both Metropolitan Achievement Teste 
Form F c , Primary I rf 
Total Reading , 
Low Metropolitan Achievement Test, 
> Form F, Primary I « 
Word Analysis 
Arithmetic Both Metropolitan Achievement Test, 

_ — Form-Fi Primary I 

Mathematics 



Grade Level I 

108 classrooms of Low'SES 



i o . 
•ERIC 



/■..J 



84 140 



OUTCOME MEASURES 
,1; . Reading 



3*~V - -* ", 



SAMPLE 



Both . Metropol 1 tan Achl evement Tes^ , 
Form F, Elementary. 
' Total Reading 
Low Metropol 1 tan-AcM evement Test, 
^_ ' Form F, Elementary ^ 

j Language ■ 

Arithmetic Both Metropolitan Achievement Test, 

Form F, Elementary 
Total Mathematics 
High Metropolitan Achievement Test/ 
Form f t Elementary 
Mathematics Concepts ••'"•,« 
Mathematics Problem-Solving 1 
Low Metropolitan Achievement Test,), 
Form F, Elementary: 
Mathematics Computation 
Attitude School Days Absent 
Self-Concept Self Intellectual Achievement 

Responsibility Scale. 

- • f »> 



Grade Level III 

58 classrooms of Low SES 



<5* 



\ 



ERIC 



85 



141 



STUDY 



|^?V^PRQCE$S MEASURES 



Solomon* Daniel and Kendall* Arthur 0. Individual Chataot**-* 
- - iatica and Ckitdrm f e P&fomano* in Varied Educational 
Setting*. Rocky^le» McL: Psychological Servltfes^ectlon, 
Montgomery County Public Schools, May 1976v V 



|$£ v^iDOTCqME MEASURES 



Classroom Observation Form 
Classroom Atmosphere Ratings, 



Erf-.'. 1 . 



Reading High California Achievement Test, 
. . Reading •, . 
Vocabulary 
Comprehension 
CAT Language 
Usage and Structure 
f Low , Cal Ifornla Achievement Test, 
Reading:'- ■ 
' Capitalization . 
Spelling ~" 
Arithmetic High California Achievement Test, 

Mathematics 
Concepts ."„'• 
Low California Achievement Test, 
Mathematics „, 
Computation 

Attitude School Self-and-Cl ass Evaluation* 
Self-Concept Self Self-Esteem (adapted from 
. --^Davidson and Greenberg) 



SAMPLE 



Grade Level IV 

50 classrooms of Hlgh'SES 



v. 



♦Specially developed for the study. 



ERIC 



86 



142 



west's > r: 4 '-'^ :t 



STUDY 



s * 



Spauldlng, Robert L. Aohievemenf^ Creativity* and Self-Concept 
Correlates of Teacher-Pupil Traneaotipjte in Elementary School 
daeeroome, Hempstead, JLY;: fiofstr^ University, 1965. 



V . ' .. 



PROCESS MEASURES 



'"A 



I'^ V - ; ; .( 1 ' Transaction Sample:' Classroom (TSC) 



OUTCOME MEASURES 

. V Reading 



/ 



SAMPLE 

' - \ 



H 



Jttgh Cooperative Sequential Tests *\ 
of Educational Progress (STEP)" 
Reading ' 

Arithmetic High Cooperative Sequential Tests 

of Educational Progress (STEP) 
Mathematics 
Self-Concept Self Self-Concept Inventory 

Grade Leyel IV, VI « -~ 
21 classrooms of High S 




*y\ 



•ERIC 



" US 1 



SYMBOL 



STUDY 



(cajroir 

County/West 

Georgia 

C*11*t) 



Coker, Homer; Lorentz, Jeffrey L. and Coker, Joan G. ' Interim. 
Report on Carroll County CBTC Projoot* Fall* 1976, This report 
covers procedures -for major analysis of first year (1974-75) 
data, reliabilities and correlations. Reported to Georgia State 
Department of Education. 1976. 



PROCESS MEASURES 



Coping. Analysis Schedule for Educational Settings (CASES) 
Spauldlng Teacher Activity Rating Schedule (STARS) 
Florida Classroom Climate and Control System (FLACCS) 
Observation Schedule and Record Form 5 Verbal (OScAR) 
Teacher Practices Observation Record (TPOR) 



OUTCOME MEASURES 



Reading 



Both 



Arithmetic Both 



Self-Concept Self 



Comprehensive Test of Basic 
Skill s, Level B, Form S 

Total ^Reading . - 
Comprehensive Test of Basic 
Skills, Level B, Form S 

Total Mathematics 
I Feel Me Feel 



SAMPLE 



fs 



3»r 



Grade Level I i 
Total of 60 classrooms of High and Low SES used 
1n the study 



S4; 



..mMmwft**. 



a. 



„4 ' ' ^-I 

.A- *4 



(vt^jcasures 



I*.. 



:k>t- 



if* sj; 



SMfPLE 



Reading High Iowa Test of Basic Skills, 

Primary Battery, Level 7, '* 
Fona 6 (ITBS-P) 
j Vocabulary ;•**< 

Reading Comprehension 
Low Iowa Tests of Basic Skills, 
Primary Battery, Level 7, 
' • ' Form * (nBS-P); sl • ••-;,« J 
. Language, ■ , 

Spelling i\ ^ • 
Arithmetic High Iowa tests of Basic Wlls, 
, Primary Battery, Level %~ 
f Form « (ITBS-P) 

: Mathematics Concepts r T 
Low Iowa Tests of Basic Skills, 
Primary Battery, Level 7,~ 

Form e (itbs-p) : | 

Mathematics Computation 
Self-Concept Self I Feel Me Feel - 



1 



' 5 - 



Grade Level II ' 
Total of 60 classrooms of 'High and Low SES used 
In the study . 



I 




'OUTCOME MEASURES 



J 



id--' 



SAMPLE 



Reading High Iowa Tests of Basic Skills, 

Forms 5 and 6, levels Edition (ITBS) 
•Vocabulary - - 

V..*: Comprehension - 
Both Iowa Tests of "Basic Skills, 

•\ Fonts 5 and 6, Levels Edition (ITBS) 
Total Language 
Arithmetic High Iowa Tests of Basic Skills, 

Forms S and 6, Levels Edition (ITBS) 
- » Mathematics Concepts . . u 

Both Iowa Tests, of Basic Skills, * 
■ t Forms S and 6, Levels Edition (ITBS) 
Total Mathematics 
Low Iowa Tests of Basic Skills, » 
Forms 5 and 6, Levels Edition (ITBS) 
Mathematics Computation 



Grade Level III-VIII , 
Total of 60 classrooms of High and Low SES .sed 
" In the study 



OUTCOME MEASURES 

: \ , Self^Concept Self I Feel Me Feel (IFMF) 

.SAMPLE V ' * ' " ' % 

- J . ' Wade Level III « s 

'OUTCOME^ MEASURES , : 

: /* \*. -~- self-Concept Self How J See Myself (HISM), 

Elementary 

'.sample. 'I ; »; r •■•->'. 



Grade Level IV-VIII 



7 



w 1 



4» 



'6'-. 



14(6 



■"5c * . - <** 




4 \\ 



MEASURES '. 

Reading;-- 



* » 

• *** * 



SAMPLE 



"6 



/<1':... 



Tests iof AcadeeW^hrogress, • .... 
For* S (TAP) V* ; * 
* Reading • % 
Arithmetic Both Tests. of Acadmlc Progress, 

For* S (TAP) .-,>., 
.. Mathematics • 
Attitude ■ School Junior , Index of Hotlvttlon (JIM) * 
Self-Concept Self How I See Myself (HISM), 
'.*":'• . "-'\ §*• .r 'Secondary'. • ^ .' 

\ : • *• 

Grade, Level IX-XII 

Total of 60 classroom of High and' Low SES used 
1n the s 




.... - - •* - 



V 



•r . 



91 



147 
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LETTERS AND COMMENTS 



When the PBTE Committee commissioned this £tudy, 1t also set' up a 
review panel of -research experts .whose function was to read the first draft 
of the report flW comments or suggestions which were to be published with* 
the report. TWe same draft wis circulated to the principal investigators of 
those studied ' whose^.f tndtngs were used in the report, and their reactions were 
also solicited under* the same terms. The responses are reproduced in this 
appendix, with the^grateful acknowledgments of the author. He. found them 
most useful^ 1n preparing the final version of the report, which includes 
changes made 1n response to some of these suggestions and comments. 
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4 Comments by The American" Federation of Teachers, AFL-CIO 

Marilyn Rauth ' < 

Assistant Director,, Education » 
Educational Research Dept. * AFT 
J ' " • . Washington, D.C. 20036 > 

. \ ; . ; . ■ • 

TM American Federation of Teachers has long Insisted that we need serious 
research on the "technology of teaching" to discover, 1f possible, what makes a 
competent teacher. We are 1n agreement with AACTE and many others that educa- 
tion would benefit from, a knowledge of demonstrable skills and behaviors required 
of a competent teacher. '•••.» . ^ 

Of all the research studies examined, 1t 1s. significant that only 12 were 
thought to have the validity required t(H>e-genera^1zed among the teacher pdpu- 
lat1on'1n terms of assessment of teacher competencies. We are not sure whether 
these studies are truly comparable or why others, have been left out. We are 
unconvinced that literature surveys of Independently developed studies really 
teW, us Anything conclusive. 

v' We would also argue that even the studies Dr. Medley does look at are 
flawed because of reliance on the process-product method. Dr. Medley states 
1n Ms report that~he-4nf ers^4»t-a4eacher who 1s effective 1s competent and 
that the one who 1s not 1s Incompetent.^ Effectiveness 1s judged on the basis 
of student achievement on standardized tests. If the teacher were the sole^ 
Influence on a child's learning, we could more easily accept these findings. 
But, obviously,* th,1s 1s not the case. The AFT has been arguing for years- that 
studies which omit home background, and many, many school -related variables 
are seriously deficient and basically worthless. ' * _ .' ' 

We recognize that Dr. Medley acknowledges tha^ research on teacher 
effectiveness 1s s tm quite limited since he uses many* qualifiers when talking 
about teacher competencies. We wonder if such extensive use of qualification 
1s not simply one more Indication of thermhereht weakness literature 
surveys. \ , - .* " 

■ - ■ . * \ .- 

If we are truly Interested 1n ascertaining what constitutes effective 
teaching, we must continue to pursue honest research that will look at all 
variables Involved, Including such things as teacher performance, societal 
and economic effects, available resources, and environmental settings. Because * 
of the expense and time Involved 1n using such comprehensive-approaches, they 
are generally rejected* and education moves forward 1n ignorance. 

- . . > ■ ■ • ■ ',»..• 

In our opinion, research on teacher competencies will notyleld Valuable 
results until all those Involved In education, whether teachers, administrators, ' 
or politicians, admit that we cannot find solutions overnight and that all 
parties, 1ncTud1ng teachers and their unions, must be Involved 1n the, search 
for answers. 
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' FAR WEST LABORATORY 
. " \ '• For Educational Research and Development 

, - '- : 1855 Folsorn St., San Francisco, Calif. 94103 « 

March 28, 1977 : - " : - . ' * 

• . - .'• ♦•*» •■ > • • • ' " . • • 

Dr. Karl Massanarl J , 
American Association of Colleges 

for Teacher Education . •« . 

One Dupont Circle A : '" 
Washington^ D.C. 20036 * 

Dear Karl: ^ ' 

I thank you for letting me comment on the Medley Review.. I admire Dr. Medley's 
stamina and agree with thfr premise... someone should turn these "findings" Into 
usable Ideas for teacher educators. In that spirit, I 1iave no comments. and 
congratulate you on the good sense to pick Dr. Medley, and I congratulate him' 
op a job well done. - . 

My concerns are not with the need for a review like this or the product, but 
with the problems In the field of research that any review worth the effort 
seems to raise. For example, the subtitle of the review 1s "A Compilation 
of Dependable Findings of Research 1n Teacher Education,", I find little 1n 
this field that would lead me to call these findings dependab1e.\The kinds 
of studies done by some of the investigators whose work met the standards of 
Medley, and 1 might add, my own present work, do not lead me td believe we 
have dependable results. We have some names and measurement 1instrjwients-for~~~ 
some variables which should be thought about seriously as-^)oVlT1vely affecting 
student achievement. • That's about assJtrong7«^tatement as I would ever make. 
Seef-for example the discouraging review of behavioral stability by Shavelspn 
:and Dempsey In RER.tfels year. 

Reviewing is an art that 1s starting to become technical and methodological. 
Gene Glass' work on statistical methodology for conducting meta-analysis of 
research 1n an, area 1s an example of such new and sophisticated approaches, to 
reviewing research. I think, were I you, I would continue to fund such reviews, 
; every _few years, because neither Medley's nor Rosenshine's, nor Heath's, nor 
DunklnTand Blddle's, etc., can capture the full knowledge 1n a field like this. 
And npne of the above used the systematic approach of Glass for the accumulation 
of data. Somebody Should! 

I am also a little bothered by some of the criteria used by Dr. Medley, The 
.criterion of a linear correlation of .39 1n this review 1s quite sensible but« 
'certainly opens the review up to certain criticisms. These have to do with 
the sample size necessary -to have a correlation of .39. be significant. At 
the .05 level this 1s, I think, about 18 cases. Since many, many interesting , 
studies of teaching have low N's., they may never get Into the "acceptable- 
for-rev1ew" category. This argument about size is made best by my friend and y 
colleague N. L. Gage 1n his paper "four cheers for research on teaching. " 
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Another' problem Is In the gain criterion, listed as criterion III. Gains are 
defined very differently In these studies. In ; at least one study used In this 
review* the "gain" Is actually a loss of points between an easy pretest and a 
hard post test. Residual 1 ration Is used 1n some but not all the studies, I 
think, and this too has unique problems.,. • 

1 could nit-pick my way through 10 or more W*ner areas, all of which are well 
known by Or. Medley and the researchers whom he reviews. 

My. point In this brief critique Is only to express, my concern that you are not 
fooled. These are Ideas to be thought about, propositions. If you will. \ But 
they are not "dependable" findings. Moreover, these studies will probably not 
be replicated or validated in anywhere like their original form. . So someone 
needs to design mini -Implementation studies to see 1f the variables seem to 
hold up on closer scrutiny. After these Implementation types of studies, 
under different conditions,- 1 might begin to use. terms like "dependable/ Till 
then, caution, caution! But If you' will stay cautious, by all means y iisc~the 
review as a take off for the design of programs 1n teacher educations. The 
review- is certainly worth serious-attention. •„ 



Sincerely yours, 



David C. Berliner , i / — 

Associate Laboratory Director „ / . / 

for Research , • 

• '• " t . •• - ' . . / :< V • ' 

DCB:er " 0 — - • ... 

cc: Don Kedley 
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P.S. Don— Can I keep my copy of the review and share 1t with the California . 
Commission for Teacher Preparation and Licensing, even In Its draft form? 
/'They should read It soon. . 

\ A Thanks, 

• ' 1 ' ---Dave- ' - 



< Comments by Oere Brophy 
Associate Professor of Educational Psychology 
v ; 1 , On! versify of Texas at Austin .v^ i , 

; . .Director^ the^Correlates of Effective Teaching" Project 

Research and Development Center for Teacher. Education In Austin; ," , 

v "* ■{ Dr. Medley has produced a useful* thought-provoking compilation and 
Integration-** research on teacher effects. The, rationale and procedures are 
clearly described,. along with their Implications, making It easy to understand , 
and; evaluate what was done. Also, the data are presented In a form that makes . 
them easy to comprehend, something that Is difficult to accomplish In-a review 
of this magnitude, in general, the document 1s well done and stands as a 
valuable contribution. Having said this, I wish to offer a few criticisms 
and suggestions. • , . , \ 

.' First, although the combined criteria of size of correlation (.39 or 
better) and probability value (.05 or below) highlight strong findings and 
eliminate borderline ones, I would not place too much stress on the sizes of 
correlations. In studies with. many subjects, correlations lower than .39 
still can be not only statistically significant but worth considering. More, 
generally, replication across studies Is more Important than the correlations 
1n any single study, so that I would nominate replication and consistency asr 
the primary criteria for Judging findings. X . r 

Similarly, I share Medley's concern with Specific, desert bable behavior, 
but I would not rule out high-Inference process measures from consideration. 
Many aspects of teaching are best measured with high-Inference methods. Even 
If It Is true that these measures are not very useful for teacher education 
until or unless broken. Into specifics, It still seems useful to take note of 
consistent findings concerning high-Inference measures as a way to' Indicate 
areas likely to be worth finer analyses to lead to more specific, low-Inference 
descriptions. _____ _ ; 

. My major concern about the review 1s that so much emphasis has-been placed 
on long-term outcomes and normative. test data, even to the point of dismissing 
short-+erm outcomes (attention, task engagement, short-term rates or levels of 
achievement). Short-term outcomes are convincing In their own right, whether 
or not they correlate with long-term outcomes. In fact, they provide the 
linkages to explain why teacher behavior. Influences long-term outcomes, 
especially test performance that Is not related In any direct way to the 
teaching behaviors of Interest. Data on long-term outcomes are needed to show 
that. the teacher behaviors have Important effects, but short-term outcomes 
lead us towards explanation of how the processes work and provide evidence 
that correlational relationships reflect causal ones. Linkages between teaching 
behaviors and short-term outcomes are useful even In the absence of Information 
about long-term outcomes, and linkages between teacher behaviors and long-term 
outcomes are Incomplete. «» •. _. r * 

the SES data discussed In the* review come from ry research/ and I hasten 
to point out that SES was used as a proxy standing for some combination of * 
ability, achievement level, and motivation. SES per se Is not the basic variable 
and overemphasizing It might lead to unfortunate fixation «n methodt^and/or to 
Increased stereotyping according to SES. Also, our data do not support the 
comment made about Integration In any direct way, and I do not Interpret them 



that way myself. It nay be true that Integration (across race* social/class,.., ' «■ 
/ability groups, or other classifications) alone does not help, but Investigations 

of trackl ng consistently reveal that segregation does not help, either. The 

Issue cannot be settled with data discussed In this report. It resolves to a 
•v'coi|*TeJt;. trade-off, between the benefits and disadvantages of homogeneous vs. 

hetero g eneous classroom composition. i *. 

" ■ A final point about interpretation should be made In reference to the 
studies by the Soars and by Stalllngs and Kaskow13z7"These usecTProject Follow . 
Through classrooms. Follow Through sponsors have specific program models that 
differ considerably from one another, and. teachers within programs tend to 
teach similarly. Therefore, process-product data from the studies In question 
do, not so much reflect teacher effects as effects. Sometimes, this 

leads to confusion. In particular, these Studies are cited as supporting the ,, 
Idea that low SES children In the early grades Team. best when taught In large 
.rather than, small groups. It happens that group size Is Inextricably confounded 
with program sponsorship In Follow Through classrooms: the programs that <get 
the best learning gains use large groups, and certain others use small' groups. 
It 1s possible that group size did have direct effects, but more likely 
that differences 1n effects resulted from differences In: curricula, and that 
these correlated group size variables do, not have any causal effects f In any 
case, W, should be kept In mind that correlational, data can suggest causality 
when, In fact, certain variables are just correlates of others that are the 
real causes, and that this danger Is compounded In studies using Follow Through 
classrooms. • v '.-. •*' •• 
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West Georgia College 
>~ ci ' i Division of the University System of Georgia 

%■ : v \* j-f" '•• ^ Carroll ton, Georgia / 30117 - 



/ 

iv.; :' ! .*Kar«h 25, V ' ' f 

^*%^si»^|CttP:T"MMswiaH , , ' 

Of rector* WE Project t ■ 
f^i:, American Association of Colleges for Teacher Education 

^Oupont /Circle, r • 
■%4 i\ Washington, D.C. ^0036 



Dear Or. Hassanarli 



Thank you for the; opportunity to review and react to Dr. Donald Medley's The 
•; Research Base fw Teacher Education. ^ - ;~ 

* H Because of the way the study Is organized and presented, It is surely the most A 

definitive, straight-forward study of process/product relationships which has , 
- W owe to. date. The four criteria useav in the .selection of research studies 
to be Included cannot be faulted.. One might wish. to alter any of all of them 
£'„ In some minor .specif 1c wtyfc) Vbyt they should stand the test of time and 
: ! / become the basis for* identifying teacher behaviors which lead to Important 

, student growth.- These Important criteria could be expanded In^lther/or both • 
^directions for. future research on "teacher effectiveness. •>"♦*' v - . 

7 It seems unlikely that anything less than long-term direct observation In the *V 
i natural setting will yield the real relationships essential to the formulation ' 
- . of an empirically based teacher education program, r Only research which attempts 
/to study all the variables in their natural, setting can possibly reveal Insights 
Into the progressive Interactions which are .present In classrooms.' Additionally, 
Cohen's Statistical Power of Analysis provides evidence that Increasing the size 
- of n's Is needed to.yield the maximum number of real relationship's which exist. - v " 
■ It might be useful If this aspect of research could be reported; f < , r * 

c . The "folklore" definitions of teacher effectiveness if whld/ Medley speaks still 
abound and/must be dispelled. Since we do not have a definition of competent 
and/or Incompetent teaching, the use of the iterms "more effective" and "less 

^ .effective? appear to be more appropriate. and more acceptable. • * ; 

All of the_"Introduct1on" Is extremely lucid; but the powerful "Rationale of. 
y, the Study" should be required ; reading for every; teacher educator Jn the nation. 

* This ; study is a landmark whjch ,ii so desperately needed at this- time.**, . 

■i V> • *" J/^* ' • ' - ' " ; .. ' • ••• •* , s ^werely, ' • « ' '» 

" \" .. 1 • *• , * * : r Homer Coker ".. . „\ ' ' .-" 

• ^ 1 Director of the Competency- » 

*> * * k •'»«.-.' Based Teacher Certification 

. . Project- - •- •' . 



;~ — r 



7. 



y .v . . .* . •*-:-. •. ' ' % 

Comments, by Albert M. Harris 
Professor of Education, Emeritus-- . »: Vh. 



s-- • New R&helle,\ New York 



• Despite decides of effort. and\hundreds of studies, the training of ~- : 
teachers Is stlfll based more on tradition andfpersonal belief than on hard 
research evidence. Dm? Medley has performed a great service 1n his effort 

'< to separate the wheat from the chaff \1n teacher effectiveness studies. The 
criteria he has used 1n Idecfding which results to* Include are stringent: 
sound research design; relationships which ^are practically as well as stat1s-~ ' 
tically significant; neasured. pupil gains Is>the criterion-, results-w]dch_can 

. be generalized to other groups of teachers* and specific description of process-, 
making the study repeatable. If 1s a pjtar that so few of the studies he 
searched mat these criteria. :. i' \i * r . ' 

*y grouping* togetKer the results of different studies, he has uncovered 
Mny Interesting trends, some of which run contrary to conventional wisdom. 
He has Identified areas 1n which -there Insubstantial consensus of evidence - 
already, and other areas 1n whtcfr the evidence *1s meagre or Inconsistent, thus 
providing direction for futuwresearch. I* _ 

However, something 1sJost[when the results of a complex study are boiled 
down to entries 1n a fewjtabTes;* The, descriptive labels 1n the tables way not 
always convey enough detail, Iboufcthe variable as 1t was defined 1n the study 
being cited. For example, the entries .concerning the CRAFT Project, which I 
directed, ere accurate, as far *s they go* but\they do not Include some essential 
information. In Medley's Table Va CRAFT res>l<fe showing a negative relationship 
between total reading, time indsreadlhp Improvement s second grade Is cited. ... 
This 1s correct; but tt applied to only one of \ the four teaching methods studied, 
1n that project (the Wnonoviiual Method), and what 1t m>ans 1s that 1n second 
, grade the teachers who spent , most time on*phoh1fc drills echlevedless Imprpve- 
ment 1n reading than the teachers who spent lesi time on such drills, in that 
particular method. Some>f the/other ; ;d1screpant results may also be based on 1 
incomplete descriptions; of: variables; 

* Dr. Medley's f1nd1ng?t»iat wlth^sW important variables what works well 
Wfth middle-class children work* poorly with le> SES children, and vice versa. . 
gives much food for thought. Hopefully, teacher educators will pay attention 
to this, and to other significant findings such as the poor results associated 
with small group work, and „the % pos1t1ve relationship between time spent on 
reeding instruction and reading results in first grade. , 
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Cements by V. Robert Houston * :?/ ' & X 

• - Associate DeanV " 7f:* * . " 
t School of Education " 
• .^University of Houston 

Houston? Texas : 



/This monograph makes several contributions to educational study. First, - 
the monograph provides a rode! fcr summarizing the findings of research studies. 
^1s procedures . Medl ey specified a set of stringent criteria, then applied 
thg to teacher effects research, reporting only findings Meeting these stan- 
dards^ These findings have bean reported using a common format; thus, not 
only the author's conclusions but also his, data base are made known to the * 
reader. 7 . * * . ■ % r - 

Second, tt»e tables and conclusions dramatically demonstrate the serious" 
• 58 :0f J^J? 0 ! 1 f** 11 ^ 1" th1s and the! need for concerted effort 
systematically to Investigate the effects of teaching behavior, to date there 
!#51 n £. t, ! torl€$ 1n teaching' as In the sciences, 4 but neither are there 
substantiated findings .upon which such theories could be built. In ancient 
Greece, ,for example, Thales' monumental . conception of the universe was based 
-on 500 years of observations by astronomers of the movements the sun, planets, 
-and-stacs^ .Likewise, the theories of /tewton, Einstein, Sallleo, and others 
were based on advancing technology In the measurement of phenomena and previous 
research In related fields. • — , * ^ 

• } r While the patterns of findings- in, teacher education reported herein are 
far«from clear, they provide a succinct basis for identifying needed areas for 
further study, stimulating research hypotheses, and understanding the relation- 
ships among studies. The Interaction between Increased precision in measuring- <1 
instructional processes and learning outcomes and systemic research studies 
In teacher effectiveness encourage long-range study and theories based on 
empirical evidence. 7 — — y 

-"' ™lrA» flRd1 ngs provide cautious cues for educating teachersloday^- , 
cautious because the populations studied were primarily In the elementary 
school, cautious because the nu»ber of studies was small, cautious because 
of several seemingly contradictory findings, and cautious because studies 
were concerned only with reading and mathematics and may not apply to less 
skill;- related subjects. However meager and Inconclusive, such bases could be 
superior to typical practices based on lore which do not lejM themselves to 
further refinement and study.- ~ 
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Counts) by Virginia Koehler 
Acting Chijef, Teaching Division 




National Institute on Education -> ; * » 

• / Washington, O.C. v 1 

* C • • A* I <\ V ^ ' • " " - 

This Is an extrej^ly. Interesting document. Don Medley has produced a 
report which provides a well organized and easily understood compilation of 
"raw empirical findings" fro* a Urge number, of complex studies., It will, 
I, am sure, be utilized for Its substance ; and as a model forergenlzing and 
presenting, this type of data. } * 

A critique of a research synthesis document Inevitably begins with a 
co mm en t on criteria utilized S»r Inclusion. Actually, I have few problems 
with the criteria, except for the one which excludes short-term relationships 
under Criterion III. I can understand excluding such findings for the sake 
of parsimony or lack of comparability. But to state that short-term learning 
gains ."are not the kinds of outcomes . . '. that teachers are hired to accom- 
plish" fmplles that one-year achievement gains on standardized tests are. As 
a researcher, as a parent, and as an ex-teacher, I would have to argue with 
this conclusion. 

I would a*so have Included a few more caveats 1n the descriptions of 
the studies. For example, there Is a major problem with construct validity 
in the category systems of the multitude of observation measures represented 
In this paper. This means,, among other things, that "teacher lectures" In 
one observation measure may not'be the same as "teacher lectures" In another 
measure. (See JBorlch and Malltz, "Convergent and Discriminant Validation of 
Three -Classroom Observation Systems: A Proposed Model", UTR&D, 1976). 
Another methodological problem is that many of the greater than .39 correlation* 
listed In the tables were found In studies with many variables and many non- 
significant correlations, making tha "significant" ones possibly random 
occurrences. (See God bout, "The Problem of Change: Significant Findings In 
/Educational Research," UTR&D, 1975.) Both of these problems may explain some 
of the contradictory findings. 

But without a doubt, the most Important caveat which needs to be 
emphasized throughout the report (a.id In fairness to Medley, he did make. It 
at the beginning! Is that these relationships are, In large part, correlational. 
Causal directions should not be Inferred from these findings. Examine, for 
example, the following Medley conclusion: "...the effective teacher maintains 
an environment that Is supportive,, and If not always quiet, free from disruptive 
pupil behavior. He maintains this environment with little apparent effort orr 
expression of negative affect." The tricky word here Is "maintains". Is Wfc 
not just as possible that the "effective" teacher happens to have few behavioral 
problem students 1n his/her class,. and therefore does not need to exert effort— 
that,* 1n fact an "Ineffective" teacher may be one with an excess, number, of 
behavioral problem children In his/her class? Realily is~probap1y somewhere 
between these two Interpretations. But the data have been Interpreted for us 
In a model which suggests that teacher behaviors affect student behaviors which 
'in tuni affect achievement gains. Experience, and some preliminary findings 
(e.g., Brophy, et al, "The Student Attributes Study: Preliminary Report" , 
UTR&p, 1976) InBTcate that there Is an Interactive process /at wqrk: that 
certain student behaviors affect teacher, behaviors and therefore outcomes, as 
well' as the other way around. 
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, also unlets some provocative, statements - statements ^hlch 

■ iWUt ae^tlohal tnalysl s beyond the scope of this project. The m>s t pro- 
owfcitif* question asked: "If there are many strategies which hive opposite" 
^<yW1^$k-mff'l*-*t *Ns« two types (or any others}* 1s It fair to the pupils 
& : .f A-^KW'w^t^kiw^)' to mix/ them together' In the same classroom?" The- conflict 
Pi$ # question 1S between notions of equal educational opportunity 

-tfaatlng all kids the same, and equal educational » 
^fe^pilSWw^ - I.e., taking. cognizance of and acting ;upon ,• \ 



'i4 



^^tartctlon research fljKi%^ But this, I believe, 



^ T " t — TV—, -.-.report Is^ctrenely Important In that It attempts to 
i-y IhcredifcTy cpjnpjex set of findings without completely digesting 

these findings for ( the reader. Medley 1s to be congratulated for developing and 
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Hay 12. 1977 



Donald,Med1ey ^ 
Professor of Education 
School of Education • 
University of Virginia 
^rlbttesvllle, Virginia 22903 < . 

Dear Don: * - , • • ' I v •■ 

i jiave reviewed your compilation of Interim research findings on research in * 
teacher education. It Is a superior piece of work, the best I have seen to 
date. Your choice of criteria for selecting studies to be Included 1s excel- 
lent, and you have done justice to the studies which are Included. The approach 
for Integrating the studies 1s excellent. ., ' ,« 

This research review 1s a significant addition to the literature on teacher . 
effectiveness. 

[•'.'-•• ' . ■ 

Sincerely yours, 



Frederick 0. McDonald 
Executive 01 rector 
National Commission of 

Performance-Based Education 
Educational Testing Service 
Rosedale Road "\ 
Princeton, New Jersey ; 08540 
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. Comments by R. S. Soar 
* "* •" Professor of Education 
Institute for Division of Human Resources 
College of Education, University of Florida 
Gainesville 



•-;v Without doubt, this review Is potentially one of the most Important things 
tlmt ha> happened 1n teicher behavior research. The selection on an eminently 
rational basis of the studies to be reviewed reduces the volume of material to 
be dealt with to one which Is manageable. But the major advance 1s the method 
of presenting results, In which findings which would have looked Inconsistent 
under any other review method can be seen to be consistent Instead. The fact 
that this procedure: frees the reader from the frame of reference of the reviewer 
and: yet. provides the data in manageable form, Is a major advance over other 
•reviews' Including those- of this author. » - 

The very success of the review, however, suggests further steps which 
would be useful. The easiest would be to- Include results of specific tests 
of interactions of teacher behavior with .pupil socioeconomic status as they, 
relate to outcome. If, for example, positive affect expression related to 
gain +.30 for low SES pupils, and -.30 for high SES pupils, this difference 
In direction of relationships would be an Interaction which would account for 
enough! variance to meet the review criteria, If explicitly tested; but the 
separate relationships as they are now reviewed would not. The importance 
of SES as a moderating variable in the review argues for the usefulness of 
reporting these explicit tests, even though they do jnot fit the organization 
of the' current review. 



-The Imposing yolume of results In the reylew supports the decision to 
use a cutoff of 152 of variance. Larger arounts of data would probably place 
a greater demand on the reader than many would accept. Bui the success of 
this procedure suggests the usefulness of repeating the review using a lower 
cutoff, perhaps one of 1W variance. In our data, about half of the corre- 
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Ultimately, it seems useful to examine' this set of studies l| more detail, 
either averaging effect-size for variables identified In the review, or pooling 
the Independent probabilities from (the various studies. The Inclusion of [ 
specific tests of Interactions might be dOne In the present review, but probably 
the inclusion of relationships with a cutoff of .3, or, the more Intensive 
analyses, should be made In additional studies. - < ' . 
. . . | | • ; I ■ ' . \ , , , - . „ ' : 

.there is an additional methodological problem which affects the results of 
the>*tudies reviewed (as Ruth Soar brings to my attention). In calculating 
regressed gain, most studies only adjust the effect of pretest out of the 
posttest score, which typically holds cohstant about* two-thirds of the variance 
(less ^if- the Interval Is more than a year). In contrast, holding IQ and socio- 
economic status constant, as well, typically holds 80-90% of the variance 
constant. This procedural difference has, two probable effects: (a). adjusting 
only. for , pretest leaves a greater amount of reliable variance available to 

: ♦ •;/'• • • ' ' J . • 
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relate to classroom behavlon, but, unfortunately* (b) It probably biases the 
resulting relationships. The relations between pupil IQ and SES at the beginning 
;4f tKe -year and teacher behavior at mid-year are often stronger than those 
between behavior and gain. As a consequence, if these pupil characteristics are 
not held constant, a spurious degree of relationship between teacher behavior- 
and pupil post-score may be created. This problem Is obviously not under the 
control of the reviewer, but It does seem worth pointing out, since the more 
carefully done studies rre likely to produce fewer significant relationships 
and smaller ones. Perhaps this characteristic of each study could be cited 
is an annotation 1n the reference 11st. This also seems Important to point 
out since this review will probably nave continuing influence on the research / 
done 1n the future. 



But these suggestions should not be seen as detracting from the reviews- 
it is a contribution whose Importance would be hard to overestimate. It will 
no longer be possible for reviewers or teacher educators to denigrate teacher 
behavior research as having nothing to contribute without their poor scholar- 
ship being evident; ami this is doubly Important, since the review makes clear 
that sone of teacher education's most dearly held beliefs are irrelevant or 
even wrong. /'-'.,-'• 
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Western KentucRy^Jnlversfty 
Office of theitean .*• 
< College of Education 
Bowling Green, Kentucky 



Nay; 11, 1977 



Or. Oonal4 Medley, Professor 

College- of Education ' *, 
-University of Virginia 
Charlottesville, Virginia 22901 / 

; Dear Don: *>..-.'••".. - 1 

Please forgive the long delay in my reaction to your excellent study of the 
research findings 1n teacher education. I think the work ybu have done 1s 
wthpdploglcally sound and your analyses of the findings are outstanding. 
I aw disappointed, however, although no fault of your study, th*t the existing 
research was so limited that the results of your studywill be limited in 
generallzablllty, I.e., generallzable pr1mar1ly;to grades I- I II and In the 
.subjects of reading and math. The Implications will be powerful, however, ■ 
; for other grades and subject areas and should stimulate great amounts of 
research and new data. ~_ ] ' . v * • 

I «"» particularly impressed with the finding that successful teacher behaviors 
.. differ so markedly between low SES and high SES groups. The Implications for- 
teacher education are startling. I wonder 1f these differences continue 
through the upper elementary grades and Into high school? Your question as 
to whether we should mix SES's 1n the same classroom 1s truly meaningful 1n 
the light of your findings, 

Eqiially i mpresslve, and contrary to most people's opinion, was ine finding 
that productive teasers do less Individual work with students but when working 
Individually, they dse/dlfferent technique. Again, here 1s much food for 
| thought 1n teacher education. 

I Perhaps one of my major concerns can be found on page 30 of the draft. I hope 
that readers will not overgenerallze the findings that the effective teacher 
of low SES's "does not encourage pupils to, analyze, synthesize, evaluate, or 
Indeed do anything but answer rather narrow questions asked by the teacher* 
The 'teacher/who encourages such pupils to express themselves freely, to think, 
to qufstlof, to discuss is not effective m teaching them to read or do 
arithmetic. You /have carefully pojhted out that these findings apply only to 
reading and arithmetic, and presumably in lower elementary grades. Obviously, 
•there will be thoSe who will quote these findings and apply them to all areas 



of study, Including the humanistic and social studies. 
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Although there are many Impressive findings 1n the study that are worthy 
of ccawent, I want to mention only two more. First, I was pleased that your? 
findings. indicated that effective teachers used more praise, encouragement/ 
arid reinforcement than did more Ineffective teachers. I have read some recent 
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research that denied $h1s finding. I happen to believe that. they dtf use more 
praise. Second, your findings suggest that effective teachers may be wore 
authoritarian than the less effective. This 1s the first concrete evidence 
to support our data from the Teacher Preparation Evaluation Program at Western 
Kentucky University., 



<3f 
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In summary, the more I read your paper, the more Impressed I became with 1t. 
My first Impressions were not nearly so supportive. I became "hirng up" on 
the: fact that the studies examined were so limited In number, dealt primarily 
with lower grade levels, and assessed progress In reading and mathematics. I # 
still belluve that these limitations should be pointed out? The beauty of 
your technique "grew" on me and your caution In Interpreting the results Is 
commendable. I support your work enthusiastically^* with the expectation 
~that4t will be misquoted and used out qf context. Despite these: probabilities, 
It; Is a highly valuabl&_p_1ece of work. Congratulations on a Job well done. 

Sincerely yours, « 



0. ,t. ; Sandefur*. Dean 
Col lege of ^Education 
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Comments by Heroldle K. Sprlggs, Ed. D. 
Educational Program Specialist 
DHEW - Of f tee of Education 
teacher Corps - ; 



The report Is designed to provide the teacher educator with access to 
the ■eanlngf ul findings of research 1n teacher effectiveness. That such access 
; isineed^:^ this report does the job outlined 1s also 

v unqueitlpnable^ .What is questionable Is the Impact this report and. others like 
*"^s$$$m&Mtft In/ the field of teacher education. In the hands_of the "wrong 
'' people' 1 such information,:can have an Impact which may be so negative that It* 
would take years tfr undo, as In the case of studies which purport -that a 
segment of Our population Is genetically inferior to other segments of the 

DODUlttlon. * 
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It appears that the author has reviewed and analyzed the findings with 
complete objectivity. There appears to be no Indication pf any value judge- ' 
■ents on the part of the writer. This must be emphasized because the study, 
tafctnout of context, or without a thorough analysis of each of the findings 
presented,: an lead to erroneous concepts about students from a low socio- 
economic status (SES). Further, other fictors *hich;\can be attributed to low 
SESrshould be carefully Considered before drawing any "conclusions from the 
study or the findings presented. These factors are the very essence of low 

l£ri m '9^J^ i W» judical facilities, poor nutrition, etc. .Elaboration 
here hopefully is not necessary. • 



For specifics, one 




look at a couple of the areas presented: ^ \ 
Organizing forlnstructlon 

""•"\ One i mwrconclude that low SES students are unable to work Independently - 
they lacMlsc1pl1ne, cannot follow directions and must be guided step by step 
Inrthefr attempts to learn. 



Quality of Instruction 



One may conclude that low SES students are unable to respond to hi 
level questions - thelrf Innate ability Is limited, they are "Intellects 
Whatever that means, inferior to high SES students. Moreover, low SES i 
. don't ask questions and: even when they do the "effective 1 * teacher Is no] 
to respond to the>student. 



jgher 

HyV 
tudents 
likely 

. What 



r? 



.There-are other areas from which negative conclusions can.be dn,* 
contributes to these conclusions Is the fact that comparisons are made {with 
higb^SES students. Why the negatlveness? While not the majority, man> low 
students In our society anTShe minorities - Black, Mexican Amerlcin and 
tve/merlcan. There are d&ltural and language differences among ttoise 
groups which are not often recognized as assets among the majority population; 
thus, because of students* backgrounds, the duality^of their /education is 
affected*' "*•* *» /•) / / - ■ "**" ' ••• \ 

; - •: „ ."' . . \ I "■ '*'.*'. ''''/..•. if 1 • ' 

"Consider the Instruments used by the researchers to measure teacher 
effectiveness . Oo these tests take'lnto consideration the cultural and language 
differences among as - • - — 



snt of the student population which Is low SES? -.<*T\ 
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l«.J*t hinds of- sensitive teacher educators, studies of this nature can 1 
be very useful In training teachers. ^ These educators will recognize* analyze 
and present those causal factors underlying the differences 1n teaching low 
SES students and high SES students. 

For those teacher educators who are Insensitive, this study and other-*, 
taken out of context, can be damaging* Teachers trained by such people may 
exit the training program reviewing low SES students 1n a negative manner, - 
and may teach 1r» a manner which assumes that °sucb students are limited In their 
ability to Team. It can laid to further segregation within. the classroom.*- 

study has the possibility of being "misconstrued or misused. Thus 
It 1s crucial that to the extent possible a% cautions or limitations of the 
study be In. readers '/users.' minds as^they proceed. It 1s with this statement 
1h mind that 1t 1s recommended that the sponsors of this compilation continue, 
with the, study. _ . 
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